Openai Compatible Python Packages

ltcai

Local-first private AI memory layer / Digital Brain for conversations, documents, decisions, and model-agnostic knowledge.

chatwalaau

The localhost AI Agent Runtime - Chat UI, Tools, RAG, and MCP in one pip install

mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

initrunner

Define AI agent roles in YAML and run them anywhere: CLI, API server, or autonomous daemon

webscout

LLM4Free — All-in-one Python toolkit for web search, AI interaction (40+ free providers), digital utilities, and more. Formerly WebScout.

museq

Model-agnostic multi-modality generation server with plugin discovery: OpenAI-compatible TTS, embeddings, and image generation. Drop a Python file in ~/.muse/models/ to add a backend.

mtplx

2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

blockrun-litellm

LiteLLM adapter for BlockRun — call x402-paid AI models through LiteLLM (custom provider or local OpenAI-compatible proxy)

hermes-router

Local AI control center and routing/control plane for OpenAI-compatible agents, local runtimes, receipts, telemetry, and safety policy.

bee-sdk

Open community repository for Bee by CUI Labs — public code, developer tooling, documentation, examples, and community-facing components for building with and contributing to Bee.

researchharness

A lightweight, general-purpose harness for tool-using LLM agents, fair benchmark evaluation, harness baselines, and personal assistant workflows.

freelm

Free, always-up LLM client & gateway for Python and TypeScript — one OpenAI-compatible API over free-tier OpenRouter, Google Gemini, NVIDIA NIM, Groq, Cerebras & Mistral with automatic failover, key rotation, streaming and live model discovery.

agenticore

Two modes, one binary — a fleet orchestrator that clones repos and ships PRs via Claude Code, OR a drop-in OpenAI-compatible chat completion endpoint for customized Claude agents with real-time token-by-token thinking + tool-call streaming. LibreChat/OpenWebUI/LiteLLM-ready. Helm + KEDA + OTEL.

wauldo

Official Python SDK for Wauldo — verified AI answers with zero hallucinations. pip install wauldo

freeride-gateway

One free AI endpoint, every free tier behind it. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, and HuggingFace with automatic failover.

llm4free

LLM4Free — All-in-one Python toolkit for web search, AI interaction (40+ free providers), digital utilities, and more. Formerly WebScout.

cli-anything-zotero

CLI server for Zotero 7/8/9 — let AI manage your library. 70+ CLI commands for search, import, PDF, BibTeX, notes, and more. Works with Claude, Cursor, ChatGPT.

ragret

Lightweight evaluation framework for Retrieval Augmented Generation systems, focused on simplicity and long-term consistency.

unified-cli

Unified Python + CLI wrapper for Claude Code, OpenAI Codex, and Google Gemini CLIs — use all three with your subscription auth from one interface (terminal CLI + importable library + OpenAI-compatible server + live dashboard)

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

vertex-proxy

Anthropic + Gemini + OpenAI API-compatible proxy for Google Cloud Vertex AI. Bridges static-URL API consumers to Vertex AI's service-account auth.

openchatci

The localhost AI Agent Runtime -- Chat UI, Tools, RAG, and MCP in one pip install

lexilux

Unified LLM API client library for Python. Simple API for Chat, Embedding, Rerank, and Tokenizer. OpenAI-compatible with streaming support and unified usage tracking.

openai-local-bridge

Trae 用第三方 API Codex。Make Trae use GPT Codex with any OpenAI-compatible API.