Llm Api Python Packages | PyRank

ai-synapse

Free AI inference router for developers - 21 providers, OpenAI-compatible

14K 3 0

freelm

Free, always-up LLM client & gateway for Python and TypeScript — one OpenAI-compatible API over free-tier OpenRouter, Google Gemini, NVIDIA NIM, Groq, Cerebras & Mistral with automatic failover, key rotation, streaming and live model discovery.

3K 1 0

lm-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

3K 137 13

llm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 137 13

ai-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 137 13

inference-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 137 13

lm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 137 13

openai-http-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 137 13

oai-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

1K 137 13

llmgate

Lightweight, provider-agnostic Python LLM library — one API for OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock & Ollama. Vision, streaming, tools, batch.

911 2 0

llmkit-python

Production-grade LLM client - Rust, Python, TypeScript. 100+ providers, 11,000+ models.

720 13 0

pyllmlib

A Simple Unified LLM API interface for OpenAI, Gemini, Mistral, Groq and more.

310 0 0

llm-api-server

LLM plugin to expose a FastAPI server with compatible APIs for popular LLM clients

222 1 0

fastapi-praisonai

FastAPI integration for PraisonAI multi-agent framework

178 1 0

flask-praisonai

Flask integration for PraisonAI multi-agent framework

144 0 1