Openai Compatible Python Packages

mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

mtplx

2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

freeride-gateway

One free AI endpoint, every free tier behind it. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, and HuggingFace with automatic failover.

cli-anything-zotero

CLI server for Zotero 7/8/9 — let AI manage your library. 70+ CLI commands for search, import, PDF, BibTeX, notes, and more. Works with Claude, Cursor, ChatGPT.

initrunner

Define AI agent roles in YAML and run them anywhere: CLI, API server, or autonomous daemon

agenticore

Two modes, one binary — a fleet orchestrator that clones repos and ships PRs via Claude Code, OR a drop-in OpenAI-compatible chat completion endpoint for customized Claude agents with real-time token-by-token thinking + tool-call streaming. LibreChat/OpenWebUI/LiteLLM-ready. Helm + KEDA + OTEL.

wauldo

Official Python SDK for Wauldo — verified AI answers with zero hallucinations. pip install wauldo

chatwalaau

The localhost AI Agent Runtime - Chat UI, Tools, RAG, and MCP in one pip install

blockrun-litellm

LiteLLM adapter for BlockRun — call x402-paid AI models through LiteLLM (custom provider or local OpenAI-compatible proxy)

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

tightwad

Mixed-vendor GPU inference cluster manager with speculative decoding

aigateway-py

Official Python SDK for AIgateway. Published on PyPI as aigateway-py.

openchatci

The localhost AI Agent Runtime -- Chat UI, Tools, RAG, and MCP in one pip install.

crewai-pathcourse

CrewAI integration for PathCourse Health — autonomous agent inference with USDC billing on Base L2

autogen-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

langchain-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

pydantic-ai-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

openai-local-bridge

Local OpenAI bridge CLI for OpenAI-compatible upstreams

code-review-ai

Multi-agent code review CLI powered by LLMs. Runs specialized agents in parallel to review GitHub PRs or local diffs.

researchharness

A lightweight, general-purpose harness for tool-using LLM agents, fair benchmark evaluation, harness baselines, and personal assistant workflows.

museq

Model-agnostic multi-modality generation server with plugin discovery: OpenAI-compatible TTS, embeddings, and image generation. Drop a Python file in ~/.muse/models/ to add a backend.

tensor-serve

ZIM-based retrieval augmented proxy for OpenAI-compatible AI

codex-openai-server

OpenAI-compatible HTTP server backed by locally authenticated ChatGPT Codex.

lexilux

Unified LLM API client library for Python. Simple API for Chat, Embedding, Rerank, and Tokenizer. OpenAI-compatible with streaming support and unified usage tracking.