PyRank

Self Hosted Llm Python Packages

Python packages with the GitHub topic self-hosted-llm. Sorted by relevance, with stars and monthly downloads.
adwantg
kvfleet

Production-grade, KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets.

475 0 0