Llm Ops Python Packages

ultracontext

Open Source Context infrastructure for AI agents. Auto-capture and share your agents' context everywhere.

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

autorag

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

friendli-client

Friendli Suite Client

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

aiconfig-extension-hugging-face

An extension for using Hugging Face tasks to parse models for AIConfig.

moralstack

MoralStack is a governance and safety layer for LLM applications. It analyzes user requests before generation, evaluates risk and intent, and decides whether the AI should answer normally, answer safely, or refuse. The goal is to make AI systems more auditable, controllable, and reliable in sensitive or regulated contexts.

python-aiconfig

AIConfig is a config-based framework to build generative AI applications.

agentcontract

Python reference implementation of the AgentContract specification

claude-code-langfuse-hook

Track Claude Code CLI usage in Langfuse per-user, per-project traces with token counts and cost estimates. Self-hosted or cloud.

longprobe

Sub-second RAG regression testing. Define golden questions, detect lost chunks in CI. pytest for your RAG pipeline.

aiconfig-extension-llama-guard

An extension for using LLama Guard with aiconfig

aiconfig-extension-gemini

An extension for using Gemini with aiconfig

aiconfig-extension-llama

Model Parser extension for Llama

ai-sdlc-framework

Declarative governance framework for AI-augmented software development lifecycles

agent-policy-layer

The standard protocol for defining runtime guardrails for your enterprise agents with a mission of trustworthy and reliable agentic systems 🛡️

wildedge-sdk

Python SDK for WildEdge

periflow-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

lm-debug-eval-ui

AIConfig is a config-based framework to build generative AI applications.

liteswarm

A lightweight framework for building AI agent systems

aiconfig-extension-groq

AIConfig is a config-based framework to build generative AI applications.

openrouter-inspector

A command-line tool for querying OpenRouter AI models and providers

arguslm

ArgusLM — Open-source LLM monitoring & benchmarking SDK