Litellm Alternative Python Packages

sandhi-gateway

Sandhi — the metering layer for AI agents. An open-source AI usage gateway: meter, attribute, and budget every model call across shared keys.

freelm

Free LLM API for Python & Node.js: a free-only, lightweight LiteLLM/OpenRouter alternative. One OpenAI-compatible client and local /v1 endpoint over Gemini, Groq, OpenRouter, Cloudflare, Mistral, NIM, Z.ai, Cohere & Kilo, with LLM fallback that races slow providers and key rotation. Works with no API keys.

justllm

Production LLM calls. Just the three lines. Cross-provider fallback, native caching, and reversible context compression on by default.

llmgate

Lightweight, provider-agnostic Python LLM library — one API for OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock & Ollama. Vision, streaming, tools, batch.