PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Self Hosted Llm Python Packages

Python packages with the GitHub topic self-hosted-llm. Sorted by monthly downloads, with stars and forks.
anchor-inference
protocore

Protocore — the agent loop, and nothing else. A protocol-first ReAct runtime for LLM agents in Python 3.12+: context budget, tool surface, compaction, snapshot and resume. No database driver, no HTTP endpoint — everything outward is a Protocol you implement. MPL-2.0.

7K 0 0
bayinfosys
bayis-marigold

Self-hosted, typed inference API for open-weight models. OpenAI-compatible, runs airgapped once your models are cached.

2K 0 0
adwantg
kvfleet

KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets. Route requests using model quality, latency, cost, policy, and live GPU state.

189 0 0
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology