PyRank

Inference Router Python Packages

Python packages with the GitHub topic inference-router. Sorted by relevance, with stars and monthly downloads.
geeks-accelerator
ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

2K 7 0