Ai Infrastructure Python Packages

distil-llm

Compression with a quality contract — cache-aware, causally-pruned LLM context compression for agentic runtimes, certified non-inferior across 7 domains. Works with any SDK.

dashclaw

🛡️The governance runtime for AI agents. Intercept actions, enforce guard policies, require approvals, and produce audit-ready decision trails.

tardigrade-db

LLM-native database kernel — persistent KV cache memory for autonomous AI agents

model-compose

Portable AI runtime inspired by docker-compose. Compose agents, RAG pipelines, and MCP servers in one YAML file and run them anywhere.

inkbox

SDK, skills, and examples for Inkbox: give AI agents a persistent identity with email, phone number, and internet address

hanzo-mcp

The Zen of Hanzo MCP: One server to rule them all. The ultimate MCP that orchestrates all others.

context-compiler

Deterministic state engine for managing conversation state and constraints in LLM applications.

kalibr

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

ultracompress

Verified AI infrastructure for regulated deployment. UltraCompress (our wedge): near-lossless 5-bit compression with SHA-256-reproducible reconstruction - prove the model in production is the one you validated. 23 architectures (0.6B-405B), Hermes-3-405B @ 1.0066x. OpenAI-compatible API. pip install ultracompress

semantica

Semantica 🧠 • Build AI systems that can explain, trace, and justify every decision. Knowledge graphs, context graphs, reasoning engines, provenance, and governance for production AI.

fast-litellm

High-performance Rust acceleration for LiteLLM - providing significant performance improvements for connection pooling, rate limiting, and memory-intensive workloads.

myco

The living armor an AI agent inhabits: eternal devouring, eternal evolution, eternal amplification.

hanzo

Hanzo AI - Complete AI Infrastructure Platform with CLI, Router, MCP, and Agent Runtime

lium-io

Rent ready-to-use cloud GPUs in seconds. Lium CLI makes it easy to launch, manage, and scale GPU compute directly from your terminal. Fast, cost-optimized, and built for AI & ML developers.

asap-protocol

Protocol for agent-to-agent communication with stateful orchestration, MCP-compatible and a public marketplace to discover and register agents.

moltos

Official Python SDK for MoltOS — The Agent Economy OS

projectdavid-platform

A single pip installed package will orchestrate a production ready instance of the AI stack in any environment

safeagent-exec-guard

Execution control layer for AI agents — prevents duplicate or incorrect real-world actions under retries, uncertainty, and stale context.

hanzoai

The official Python library for the Hanzo API

awaithumans

Pause your AI agent. Ask a human. Resume with their answer. Open source human-in-the-loop (HITL) library for production LLM agents: Slack, email, and web dashboard. Typed Pydantic and Zod responses. Durable Temporal and LangGraph adapters. AI verifier. Audit trail. Self-hosted, Apache 2.0. Python and TypeScript.

memlayer

Plug-and-play memory for LLMs in 3 lines of code. Add persistent, intelligent, human-like memory and recall to any model in minutes.

agent-policy-layer

The standard protocol for defining runtime guardrails for your enterprise agents with a mission of trustworthy and reliable agentic systems 🛡️

skarta

Production-grade Rust runtime for multi-agent AI systems. Orchestrate LLM agents, skills, and DAG workflows with native Python and Rust SDKs.

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.