PyRank

Inference Router Python Packages

Python packages with the GitHub topic inference-router. Sorted by monthly downloads, with stars and forks.
geeks-accelerator
ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

3K 24 5