PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Ai Gateway Python Packages

Python packages with the GitHub topic ai-gateway. Sorted by relevance, with stars and monthly downloads.
BerriAI
litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

464.4M 48K 8K
BerriAI
litellm-proxy-extras

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

1.5M 48K 8K
BerriAI
litellm-enterprise

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

1.3M 48K 8K
Portkey-AI
portkey-ai

Build reliable, secure, and production-ready AI apps easily.

598K 112 29
Shaivpidadi
freeride-gateway

One free AI endpoint, every free tier behind it. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, and HuggingFace with automatic failover.

8K 6 1
AI-Stats
ai-stats-py-sdk

Open-source, OpenAI-compatible AI gateway with health-aware routing, failover, and live telemetry (cost, latency, errors). Built for production.

3K 5 3
BlockRunAI
blockrun-litellm

LiteLLM adapter for BlockRun — call x402-paid AI models through LiteLLM (custom provider or local OpenAI-compatible proxy)

3K 1 0
geeks-accelerator
ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

2K 7 0
Hypothesize-Tech
cost-katana

Cost Katana Python

2K 0 0
wso2
amp-instrumentation

WSO2 AI Agent Manager is an open control plane designed for enterprises to deploy, manage, and govern AI agents at scale.

2K 44 31
smigolsmigol
llmkit-sdk

Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.

778 10 3
Kenza-AI
sagify

LLMs and Machine Learning done easily

775 443 68
ferro-labs
ferrolabsai

Ferro Labs AI Gateway Python SDK - Instrument your LLM app, Works with any LLM or framework

673 1 0
MichaelAdamGroberman
freemygpt

FreeMyGPT — HTTP gateway that lets ChatGPT (and any LLM) drive any local MCP server via simple GET requests. Hybrid: MCP stdio backends by default, Codex CLI and other runtimes via bundled adapters.

658 2 0
shin-bot-litellm
litellm-mcp

MCP server giving AI agents access to 100+ LLMs through LiteLLM

597 38K 6K
Portkey-AI
rubeus

Build reliable, secure, and production-ready AI apps easily.

570 112 29
Lokesh-Chimakurthi
rosetta-llm

Multi-format LLM proxy — translates OpenAI Chat, OpenAI Responses & Anthropic Messages. Works as a Claude Code LLM gateway with full model picker support.

550 7 1
pouriamrt
fastapi-ai-router

FastAPI middleware that turns your existing routes into a natural-language-callable surface using LLM function-calling. Drop-in. Zero new metadata.

549 1 0
BerriAI
litellm-dev

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

528 48K 8K
vllm-project
vllm-sr-sim

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

483 4K 673
ferro-labs
llama-index-llms-ferrolabsai

Ferro Labs AI Gateway Python SDK - Instrument your LLM app, Works with any LLM or framework

436 1 0
Tanantor
langgate

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

401 6 0
schmitech
schmitech-orbit-client

An MCP Python client for interacting with Orbit chat servers

346 267 46
ferro-labs
langchain-ferrolabsai

Ferro Labs AI Gateway Python SDK - Instrument your LLM app, Works with any LLM or framework

338 1 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery