Llm Router Python Packages

claude-code-llm-router

Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain keeps costs 70–85% lower.

sawyer-core

Distributed MoE inference network — the load is split, friends help.

llm-routing

Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain keeps costs 70–85% lower.

xrouter-llm

A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and +1.9 pts completion on our tested dataset.

freellmpool

Free LLM API pool: 19 LLM providers cataloged, 235 routes, 355 cataloged chat models, keyless start when available.

freelm

Free, always-up LLM client & gateway for Python and TypeScript — one OpenAI-compatible API over free-tier OpenRouter, Google Gemini, NVIDIA NIM, Groq, Cerebras & Mistral with automatic failover, key rotation, streaming and live model discovery.

hermes-plugin-clawrouter

ClawRouter for Hermes — 55+ LLMs, x402 USDC micropayments on Base & Solana. Python plugin wrapping the ClawRouter proxy for NousResearch/hermes-agent.

nadirclaw

Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

anymodel-py

OpenRouter-compatible LLM router for Python. Route requests across OpenAI, Anthropic, and Google with a single API.

opencode-llmstack

Cursor-Auto / Claude-tier-style serving for local GGUF models on Mac (M4 Max, 64 GB). FastAPI router fronts llama-swap + llama.cpp, classifying each request into a coder, planner, or uncensored-planner tier. OpenAI-compatible API, opencode integration, per-project subshell, one `llmstack` console-script.

fugusashi

Fugusashi — Federated Learning of LLM Routing with Human-Interpretable Decisions. Open-source alternative to Sakana AI Fugu.

llm-localfirst

Local-first LLM router — keep sensitive data and bulk text labor on your own models; call the cloud only for the hard part. Fail-closed privacy routing + manager-worker delegation, MCP-native.

hiway2llm

HiWay2LLM SDK (Python) — OpenAI-compatible client for the HiWay router. BYOK, 40-60% savings, 0% markup on inference.

tanglebrain

A local-first, config-driven LLM router across OpenAI-compatible backends you own.

llm-freellmpool

Free LLM API pool: 19 LLM providers cataloged, 235 routes, 355 cataloged chat models, keyless start when available.

llmbuffet

An all-you-can-eat buffet of free-tier LLM APIs behind one OpenAI-compatible endpoint, with automatic failover and quota tracking.

mmrouter

Cut LLM costs 40-70% with intelligent routing. Classifies prompts by complexity, routes to the cheapest model that works. OpenAI-compatible API, three classifier strategies, YAML config.

routelayer

Unified LLM routing with automatic fallback, cost-aware model selection, and semantic caching.