Gateway Python Packages

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

litellm-proxy-extras

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

litellm-enterprise

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

fastapi-proxy-lib

HTTP/WebSocket proxy for starlette/FastAPI

mcp-contextforge-gateway

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

youless-api

A python bridge interface to the YouLess energy monitor.

xs1-api-client

A python library for accessing the EZcontrol® XS1 Gateway API

rosetta-llm

Multi-format LLM proxy — translates OpenAI Chat, OpenAI Responses & Anthropic Messages. Works as a Claude Code LLM gateway with full model picker support.

migate

Xiaomi authentication gateway for Python

abstractgateway

The production HTTP control plane for durable AI runs. Start, schedule, observe, and replay AI workflows across any client — terminal, browser, tray, Telegram, or email. Replay-first architecture with append-only ledger.

abstractframework

Write once. Generate everything. A modular, open-source ecosystem for building durable, observable, multimodal AI systems. Text, voice, image, video, music — one unified interface, any provider, any model, local or cloud.

jupyter-enterprise-gateway

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

litellm-dev

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

jigor

zero-shot classifier models gateway and runner

discord-http

An HTTP-first Python library for Discord bots, running on HTTP interactions, the gateway, or both, with full cache control.

opengateways

OSS Open Gateway for your agents and people

abstractmemory

Write once. Generate everything. A modular, open-source ecosystem for building durable, observable, multimodal AI systems. Text, voice, image, video, music — one unified interface, any provider, any model, local or cloud.

rmyndharis-openwa

Free, Open Source, Self-Hosted WhatsApp API Gateway

mcp-gtw

Generic, installable Model Context Protocol (MCP) gateway.

agent-chat-gateway

Turn your AI agent into a team-shared chatbot — in minutes. Supports Rocket.Char, Claude and Opencode

verdict-core

Fail-closed LLM routing: cheapest qualified model, named drop reasons, receipts.

moyasar

Moyasar Python client library

abstractllm

A unified interface for Large Language Models with memory, reasoning, and tool capabilities. Supports OpenAI, Anthropic, Ollama, HuggingFace, and MLX with hierarchical memory system and agent development features.

thingsboard-gateway

Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.