PyRank

Llm Api Python Packages

Python packages with the GitHub topic llm-api. Sorted by relevance, with stars and monthly downloads.
thatAverageGuy
llmgate

Lightweight, provider-agnostic Python LLM library — one API for OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock & Ollama. Vision, streaming, tools, batch.

3K 2 0
Nayjest
ai-proxy-server

AI Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

2K 127 12
Nayjest
lm-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

2K 127 12
Nayjest
llm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

967 127 12
Nayjest
openai-http-proxy

OpenAI HTTP Proxy is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

807 127 12
Nayjest
inference-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

792 127 12
Nayjest
lm-proxy-server

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

711 127 12
Nayjest
oai-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

637 127 12
yfedoseev
llmkit-python

Production-grade LLM client - Rust, Python, TypeScript. 100+ providers, 11,000+ models.

542 11 0
yazirofi
pyllmlib

pyllmlib is a lightweight, provider-agnostic Python package that gives you one simple interface to work with multiple Large Language Model (LLM) APIs.

293 0 0
danielcorin
llm-api-server

API server for `llm` CLI tool

194 1 0
MervinPraison
fastapi-praisonai

FastAPI integration for PraisonAI multi-agent framework

96 1 0
MervinPraison
flask-praisonai

Flask integration for PraisonAI multi-agent framework

89 0 1