Model Routing Python Packages

neuralbrok

NeuralBroker — A VRAM-aware LLM router. Daemon polls GPU every 500ms, routes requests to local Ollama or cloud Groq based on real-time VRAM state. Single OpenAI-compatible endpoint at localhost:8000

uncommon-route

Automatic LLM router — 82% cost savings, 79.4% accuracy, 93.4% pass rate. Drop-in OpenAI proxy.

kalibr

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

nadirclaw

Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

routesmith

Host-aware model routing for coding agents. Python library + MCP server for Claude Code, Codex, Gemini CLI, Copilot, Cursor, and Aider.

syrin

The Python Harness for Production AI Multi-Agent Systems

langchain-router

Cost-aware model routing for LangChain agents. Routes execution turns to a fast model, keeps the expensive model for planning and recovery.

llm-cost-reduction

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

llm-cost-optimizer

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

hyperion-ai

Ultra-low-latency LLM gateway with microsecond caching, dynamic routing, budgets, analytics, and forecasting.

mmcp-core

Multi-Model Collaboration Pipeline — orchestrate AI models as a DAG. RL routing, multi-verifier voting, agent mesh, self-improving. Works with OpenAI, Anthropic, Gemini, DeepSeek. npm install mmcp-core | pip install mmcp-core

livekit-ai-switchboard

Drop-in LLM router for LiveKit voice agents — route between N models using topics, heuristic signals, and custom rules

langchain-kalibr

LangChain integration for Kalibr. Route every LangChain LLM call to lower-cost model paths without degrading performance.

stratarouter

High-performance semantic routing backed by a Rust core