PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Model Routing Python Packages

Python packages with the GitHub topic model-routing. Sorted by relevance, with stars and monthly downloads.
khan-sha
neuralbrok

NeuralBroker — A VRAM-aware LLM router. Daemon polls GPU every 500ms, routes requests to local Ollama or cloud Groq based on real-time VRAM state. Single OpenAI-compatible endpoint at localhost:8000

15K 0 0
CommonstackAI
uncommon-route

Automatic LLM router — 82% cost savings, 79.4% accuracy, 93.4% pass rate. Drop-in OpenAI proxy.

8K 524 20
kalibr-ai
kalibr

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

7K 30 3
doramirdor
nadirclaw

Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

2K 497 58
sidrat2612
routesmith

Host-aware model routing for coding agents. Python library + MCP server for Claude Code, Codex, Gemini CLI, Copilot, Cursor, and Aider.

2K 3 0
syrin-labs
syrin

The Python Harness for Production AI Multi-Agent Systems

879 55 12
johanity
langchain-router

Cost-aware model routing for LangChain agents. Routes execution turns to a fast model, keeps the expensive model for planning and recovery.

569 5 0
kalibr-ai
llm-cost-reduction

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

226 30 3
kalibr-ai
llm-cost-optimizer

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

217 30 3
hyperion-hq
hyperion-ai

Ultra-low-latency LLM gateway with microsecond caching, dynamic routing, budgets, analytics, and forecasting.

141 14 3
RagavRida
mmcp-core

Multi-Model Collaboration Pipeline — orchestrate AI models as a DAG. RL routing, multi-verifier voting, agent mesh, self-improving. Works with OpenAI, Anthropic, Gemini, DeepSeek. npm install mmcp-core | pip install mmcp-core

138 32 0
vantxlab
livekit-ai-switchboard

Drop-in LLM router for LiveKit voice agents — route between N models using topics, heuristic signals, and custom rules

114 0 0
kalibr-ai
langchain-kalibr

LangChain integration for Kalibr. Route every LangChain LLM call to lower-cost model paths without degrading performance.

92 0 0
ai-deeptech
stratarouter

High-performance semantic routing backed by a Rust core

82 8 4
    • Data from PyPI, GitHub, ClickHouse, and BigQuery