Model Routing Python Packages

xrouter-llm

A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and +1.9 pts completion on our tested dataset.

hermes-router

Local AI control center and routing/control plane for OpenAI-compatible agents, local runtimes, receipts, telemetry, and safety policy.

kalibr

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

switchboard-local

Privacy-aware, local-first router for your CLI coding agents (Codex, Claude Code) and local LLMs (Ollama) — keeps sensitive prompts on-device and cuts premium-model usage.

nadirclaw

Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

neuralbrok

Local-first LLM routing gateway — use model='neuralbroker' and it routes intelligently between local Ollama, discovered subscriptions (Claude Pro, Codex), and paid API fallbacks.

uncommon-route

Local LLM router that cuts premium-model spend with adaptive 3-tier routing, OpenAI + Anthropic compatible

crupier

Python orchestration SDK for routing, combining, and auditing AI model calls.

langchain-router

Cost-aware model routing for LangChain agents based on task phase

local-gateway

Desktop LLM gateway with multi-provider failover and model name mapping

syrin

The AI Harness for Python Developers — wrap any LLM with budget control, persistent memory, sandboxed execution, multi-agent orchestration, and production observability.

routesmith

Auto-route coding agent tasks to the best model in your IDE. Python library + MCP server for Claude Code, Codex, Gemini CLI, Copilot, Cursor, and Aider.

mmcp-core

Multi-Model Collaboration Pipeline — orchestrate AI models as a DAG. RL routing, multi-verifier voting, agent mesh, self-improving. Works with OpenAI, Anthropic, Gemini, DeepSeek. npm install mmcp-core | pip install mmcp-core

signalforgeai

Opinionated platform for agentic workflows, tooling, and evaluation.

claude-router

Embedding-based scaffold router for Claude API. Routes tasks to the right scaffold using centroid matching. By Hermes Labs.

llm-cost-optimizer

Automatically reduce LLM API costs. Routes to cheapest model that succeeds. Use kalibr instead.

llm-cost-reduction

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

langchain-kalibr

LangChain integration for Kalibr. Route every LangChain LLM call to lower-cost model paths without degrading performance.

stratarouter

High-performance semantic routing backed by a Rust core

livekit-ai-switchboard

Drop-in LLM router for LiveKit voice agents — route between N models using topics, heuristic signals, and custom rules

hyperion-ai

The official Python SDK for the Hyperion AI Gateway