Llm Proxy Python Packages

my-claude-code

My Claude Code (MCC) is a local multi-provider LLM proxy, model router and control plane for Claude Code, Codex, OpenCode, Gemini CLI and other AI coding agents — 57 providers, fallback routing, credential health, a native web-search tool proxy, and exhaustive analytics with cost provenance in one local dashboard.

llmshim

A pure-Rust LLM API translation layer — one OpenAI-shaped request, routed and translated to OpenAI, Anthropic, Gemini, and xAI.

rosetta-llm

Multi-format LLM proxy — translates OpenAI Chat, OpenAI Responses & Anthropic Messages. Works as a Claude Code LLM gateway with full model picker support.

claude-tap

Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer.

shad0wllm

System 0 for your LLM: learns the fixed-choice answers your LLM gives (intents, routing, moderation) and serves the repeats in microseconds from a small CPU table, at most 5% disagreement, certified. Zero-code proxy for the OpenAI Decisions API, System One and chat models.

inferrail

Self-hosted OpenAI/Anthropic-compatible gateway: give each AI agent run a dollar budget, enforced before the provider, with a payload-free per-run cost record.

hubrelay

Self-hosted LLM gateway — from LAN to the public internet (tunnel-friendly): multi-upstream key pool, downstream tokens, quota accounting, MCP & A2A routing, E2E envelope encryption. 自托管大模型中转站，局域网与公网两用，兼容 OpenAI/Anthropic。

privyx

AI data privacy gateway: privacy engine + proxy for LLM providers

ferrogw

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

privaite

Self-hosted PII redaction proxy for LLM APIs and agent CLIs. Scrubs names, emails and secrets from Claude Code, Codex and any OpenAI-compatible app before requests leave your machine, tool-call arguments included, then restores them in the reply. Local detection, zero telemetry.

sous-mcp

Run Claude Code's subagents on a local LLM (MLX, Qwen) on Apple silicon and stretch your Pro/Max usage limits: a local daemon that serves subagent turns from the local model and proxies everything else to Anthropic unchanged. Hybrid local + cloud — Claude keeps the main loop, the local model does the subagent work, Claude Code runs every tool.

gpt2giga

FastAPI proxy for OpenAI, Anthropic and Gemini compatible clients backed by the GigaChat API

airelays

Independent OpenAI-compatible local relay for your own ChatGPT and Claude subscriptions: one standard /v1 API (chat completions, responses), multi-account balancing with automatic failover and retry, and a cross-platform desktop app. Single-user personal use; not affiliated with any provider.

stuntd

Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI compatible.

llimona

Llimona is an open and modular Python framework for building production-ready LLM gateways

openai-api-server-via-codex

Lightweight OpenAI-compatible API server in Go, backed by your Codex/ChatGPT login. Use existing OpenAI clients within your Codex limits

blockrun-litellm

LiteLLM adapter for BlockRun — call x402-paid AI models through LiteLLM (custom provider or local OpenAI-compatible proxy)

cachellm-proxy

A drop-in semantic cache for LLM APIs. One proxy routes to OpenAI, Gemini, Groq, Claude, Ollama and Bedrock. 77% hit rate, 78% lower cost, zero wrong answers on new questions.

rlcd-gateway

Self-hosted gateway for LLMs and decision models. Claude Code, Codex, OpenCode and any OpenAI/Anthropic SDK app reach any provider (OpenRouter, Groq, Ollama…) with context pruning; Jev and open-rlcd System One decisions get audit and calibration. Live dashboard, single Go binary.

freelm

Free LLM API for Python & Node.js: a free-only, lightweight LiteLLM/OpenRouter alternative. One OpenAI-compatible client and local /v1 endpoint over Gemini, Groq, OpenRouter, Cloudflare, Mistral, NIM, Z.ai, Cohere & Kilo, with LLM fallback that races slow providers and key rotation. Works with no API keys.

ai-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

llm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

lm-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

openai-http-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.