PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Llm Proxy Python Packages

Python packages with the GitHub topic llm-proxy. Sorted by relevance, with stars and monthly downloads.
llimona-org
llimona

Llimona is an open and modular Python framework for building production-ready LLM gateways

8K 1 0
BlockRunAI
blockrun-litellm

LiteLLM adapter for BlockRun — call x402-paid AI models through LiteLLM (custom provider or local OpenAI-compatible proxy)

3K 1 0
doramirdor
nadirclaw

Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

2K 497 58
Nayjest
ai-proxy-server

AI Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

2K 127 12
Nayjest
lm-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 127 12
Nayjest
llm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

954 127 12
Nayjest
openai-http-proxy

OpenAI HTTP Proxy is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

798 127 12
Nayjest
inference-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

788 127 12
Nayjest
lm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

678 127 12
Nayjest
oai-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

618 127 12
open-bias
openbias

Open Source Reliability Harness: Make your agents follow rules. One line of code to‎ ‎enforce, trace, and improve. ‎ ‎

589 117 3
elifarley
vandamme-proxy

Simultaneous multi-provider proxy for Claude Code - Do the splits with your Claude requests.

561 1 0
Lokesh-Chimakurthi
rosetta-llm

Multi-format LLM proxy — translates OpenAI Chat, OpenAI Responses & Anthropic Messages. Works as a Claude Code LLM gateway with full model picker support.

558 7 1
poushwell
orchesis

Transparent HTTP proxy for AI agents. Block threats, cut token waste, monitor your fleet. Zero code changes. MIT license.

421 4 2
open-sentinel
opensentinel

Reliability layer for AI agents - monitors workflow adherence and intervenes when agents deviate

224 101 3
kikuai-lab
reliapi-sdk

Python SDK for reliapi - Reliability layer for API calls

216 8 0
hyperion-hq
hyperion-ai

Ultra-low-latency LLM gateway with microsecond caching, dynamic routing, budgets, analytics, and forecasting.

142 14 3
tokligence
tokligence

Tokligence Gateway - Multi-platform LLM gateway with unified OpenAI, Anthropic, and Google Gemini APIs

138 1 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery