PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Llm Infrastructure Python Packages

Python packages with the GitHub topic llm-infrastructure. Sorted by monthly downloads, with stars and forks.
rlippmann
context-compiler

Deterministic state engine for managing conversation state and constraints in LLM applications.

3K 2 0
SergioZ3R0
nvprobe

nvProbe - Open-source NVIDIA GPU benchmark suite for CUDA workload automation, Slurm HPC cluster profiling, and MLPerf reporting

2K 7 1
rlippmann
context-compiler-directive-drafter

Draft candidate Context Compiler directives from natural-language input.

1K 0 0
rlippmann
context-compiler-example-integrations

Example integrations and enforcement-point demonstrations for Context Compiler.

995 0 0
damper-ai
damper

Reliability control for the Anthropic Python SDK

74 8 0
Krako-Labs
getkora

AI Workload Control Layer for routing deterministic, reusable, retrieval-needed, tool-needed, and provider-needed work before model invocation.

72 26 21
sauravvenkat
dotprmpt

prmpt is a declarative, versioned behavioral contract that specifies how an LLM must be invoked, constrained, composed, and interpreted by the surrounding system in order to produce reproducible behavior.

68 0 0
marco-spagn
pcmi

Persistent Cognitive Memory Infrastructure — durable, multi-tenant memory layer for AI agents. HTTP + gRPC, hybrid retrieval, background workers, observability. Go.

59 5 2
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology