Llm Ops Python Packages

tracely-ai

Tracely Python SDK: automatic + manual agent tracing, exported to Tracely over OTLP.

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

lintlang

Static analysis for AI agent configs, tool descriptions, and system prompts — catches vague tool descriptions, missing stop conditions, and schema gaps before they reach runtime. Zero-LLM, deterministic checks, built for CI.

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

boundflow-charter

Build and operate production-safe agents that run in your own environment.

acruxcore

Open-source LLMOps platform with prompt management, an OpenAI-compatible AI gateway, OpenTelemetry tracing, a versioned tool catalog, and LLM evaluation. Use hosted or self-host with TypeScript and Python SDKs.

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

boxdawn

Open your AI agents' black box. The waste is between your agents, not inside them. Four deterministic detectors over one trace file, priced from real usage fields. Hosted at boxdawn.com.

friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

python-aiconfig

AIConfig is a config-based framework to build generative AI applications.

claude-router

claude-router is a local prompt router that picks the right Claude model tier and prepends the right scaffold using local embeddings before you call the API. A deterministic routing layer for eval, research, content, and review prompts that helps teams stop overspending on Sonnet and Opus when Haiku plus structure is enough.

csv-quality-gate

csv-quality-gate is a command-line data quality gate that runs CSV preflight validation, failing fast before an ML or LLM pipeline ingests broken, incomplete, duplicated, or junk input. It checks missing columns, empty files, empty cells, and duplicate rows, returning pass, warn, or fail with matching exit codes. Stdlib-only, CI-ready.

langstate

Inspectable context compression for LLM conversations: turn older history into visible scaffold state, keep recent turns verbatim, and check named facts with lexical receipts.

aiconfig-extension-gemini

AIConfig is a config-based framework to build generative AI applications.

hermeneutic

Turn corrections from AI agent logs into guidance for similar tasks. Local memory with semantic retrieval, prompt-context hooks, and response checks.

wildedge-sdk

Python SDK for WildEdge

aiconfig-extension-groq

AIConfig is a config-based framework to build generative AI applications.

aiconfig-extension-hugging-face

AIConfig is a config-based framework to build generative AI applications.

zer0lint

zer0lint is a memory-extraction health diagnostic for mem0 configs and HTTP memory endpoints. It flags silent failure modes where ingestion reports success but facts never survive the LLM extraction step, then generates a stronger extraction prompt validated on your own model. Works over HTTP with any add/search memory API.

ultracontext

Open Source Context infrastructure for AI agents. Auto-capture and share your agents' context everywhere.

quickthink

quickthink is a local-first CLI and Python library that wraps Ollama-backed LLM calls with a compressed plan-then-answer scaffold and latency-aware routing. It adds a short validated planning step for multi-step prompts and routes simple ones straight through. Local inference control for small models.

ai-sdlc-framework

Declarative governance framework for AI-augmented software development lifecycles

agentcontract

Python reference implementation of the AgentContract specification

diffprompt

git diff for prompt engineers - catch behavioural prompt regressions before they ship.