PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Ai Infrastructure Python Packages

Python packages with the GitHub topic ai-infrastructure. Sorted by relevance, with stars and monthly downloads.
Battam1111
myco

Self-evolving cognitive organism for AI agents β€” eternal devouring, eternal evolution.

15K 61 7
sipsalabs
ultracompress

Lossless 5-bit transformer compression. 22 architectures shipped (0.6B-405B incl. dense + MoE + SSM), 14 PPL-verified. Hermes-3-405B 1.0066x, Mistral-7B 1.00548x, Mixtral-8x7B 1.00368x. SHA-256-verifiable bit-identical reconstruction. OpenAI-compatible API at api.sipsalabs.com. pip install ultracompress

10K 12 0
kalibr-ai
kalibr

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

7K 30 3
rlippmann
context-compiler

Deterministic state engine for managing conversation state and constraints in LLM applications.

7K 0 0
inkbox-ai
inkbox

SDK, skills, and examples for Inkbox: give AI agents a persistent identity with email, phone number, and internet address

7K 10 1
hanzoai
hanzo-mcp

Model Context Protocol server with 260+ tools for AI agents

5K 9 9
Datura-ai
lium-io

Rent ready-to-use cloud GPUs in seconds. Lium CLI makes it easy to launch, manage, and scale GPU compute directly from your terminal. Fast, cost-optimized, and built for AI & ML developers.

4K 5 2
Shepherd217
moltos

🦞 The Agent Economy OS β€” Persistent identity, cryptographic memory, compounding reputation, and a real marketplace for autonomous agents. Free. MIT. Live.

3K 3 0
project-david-ai
projectdavid-platform

Deployment orchestrator for the Project David / Entities platform

3K 1 0
awaithumans
awaithumans

The human layer for AI agents. Your agents already await promises. Now they can await humans.

2K 6 1
ucsandman
dashclaw

πŸ›‘οΈDecision infrastructure for AI agents. Intercept actions, enforce guard policies, require approvals, and produce audit-ready decision trails.

2K 264 48
geeks-accelerator
ollama-herd

Local AI load balancer for Ollama fleets β€” auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

2K 7 0
hanzoai
hanzo

Hanzo Python SDK β€” LLM gateway, agents, and AI cloud

2K 2 0
adriannoes
asap-protocol

Standard protocol for agent-to-agent communication with stateful orchestration, MCP-compatible and a public marketplace to discover and register agents.

2K 13 2
hanzoai
hanzo-agents

Python SDK for the Hanzo Agents control plane

2K 2 0
divagr18
memlayer

Plug-and-play memory for LLMs in 3 lines of code. Add persistent, intelligent, human-like memory and recall to any model in minutes.

2K 274 33
Datura-ai
lium-cli

DEPRECATED: This package has been renamed to lium.io. Install lium.io instead.

1K 5 2
hanzoai
hanzo-tools-agent

Hanzo Python SDK β€” LLM gateway, agents, and AI cloud

1K 2 0
basnetlachu
memopt-engine

MEMOPT: Universal Memory Fabric for AI Infrastructure. Open-sourced by Sophisticates.

1K 4 1
petterjuan
agentic-reliability-framework

ARF is an agentic reliability intelligence platform that separates decision intelligence (OSS) from governed execution (Enterprise), enabling autonomous operations with deterministic safety guarantees.

994 19 5
azender1
safeagent-exec-guard

AI agent execution guard β€” prevents duplicate actions from retries with exactly-once execution, request-id dedup, and durable receipts.

925 4 0
hanzoai
hanzo-tools-net

Hanzo Python SDK β€” LLM gateway, agents, and AI cloud

728 2 0
ddickmann
vllm-factory

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

717 59 6
hanzoai
hanzo-tools-fs

Hanzo Python SDK β€” LLM gateway, agents, and AI cloud

717 2 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery