Openai Compatible Python Packages

chatwalaau

The localhost AI Agent Runtime - Chat UI, Tools, RAG, and MCP in one pip install

xllamacpp

xllamacpp - a Python wrapper of llama.cpp

federaide

P2P multi agent orchestration harness, universal automation system and IDE

bee-sdk

Open community repository for Bee by Heossi — public code, developer tooling, documentation, examples, and community-facing components for building with and contributing to Bee.

rapid-mlx

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

ddg-agent-services-mcp

Pay-per-call x402 gateway for AI agents — MCP server + OpenAI-compatible API for agent tools, market data, RPC, and MCP security audits. Pay in USDC on Base, no account.

federaide-dev-nightly

P2P multi agent orchestration harness, universal automation system and IDE

ai-jury

Stdlib-only Python CLI that orchestrates universal AI agent providers (Claude Code, Codex, Antigravity, OpenRouter, DeepSeek, Groq, local models, Aider) into a multi-agent PR review jury — debate, verify, synthesize one verdict. Local-first, secure by default.

agentao

Local-first, governed AI agent runtime for Python — embed it in your app, or run it as a CLI or ACP server. Permissions, MCP, memory and audit replay built in.

roboz

Python framework for typed LLM agents with conditional tool chaining.

hugpy-video

Self-hosted LLM console, OpenAI-compatible API and GPU worker fleet: 13 hugpy-* Python distributions and the React consoles.

inferrail

Self-hosted OpenAI/Anthropic-compatible gateway: give each AI agent run a dollar budget, enforced before the provider, with a payload-free per-run cost record.

webscout

LLM4Free — All-in-one Python toolkit for web search, AI interaction (40+ free providers), digital utilities, and more. Formerly WebScout.

hugpy

Self-hosted LLM console, OpenAI-compatible API and GPU worker fleet: 13 hugpy-* Python distributions and the React consoles.

federate

P2P multi agent orchestration harness, universal automation system and IDE

mtplx

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

abstractvision

Model-agnostic generative vision for Python and AbstractCore — text/image/video generation via MLX-Gen, Diffusers, stable-diffusion.cpp, and OpenAI-compatible APIs.

mcp-aichat

MCP server for AI dialogue across multiple LLM models via Ace Data Cloud.

initrunner

Define AI agent roles in YAML and run them anywhere: CLI, API server, or autonomous daemon

ferrogw

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

hugpy-engine

Self-hosted LLM console, OpenAI-compatible API and GPU worker fleet: 13 hugpy-* Python distributions and the React consoles.

agentic-security-harness

Test whether AI agents keep repo text, tools, memory, and audit trails inside their authority boundaries; outputs traces, scorecards, and remediation reports.

dflash-console

Local Windows control panel for llama-server and DFlash speculative-decoding engines.