Prompt Engineering Python Packages

mlflow-skinny

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow-tracing

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

partial-json-parser

Parse partial JSON generated by LLM

banks

LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. It allows attaching metadata to prompts to ease their management, and versioning is first-class citizen. Banks provides ways to store prompts on disk along with their metadata.

opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

arize-phoenix-otel

AI Observability & Evaluation

outlines

Structured Outputs

arize-phoenix-client

AI Observability & Evaluation

arize-phoenix-evals

AI Observability & Evaluation

arize-phoenix

AI Observability & Evaluation

headroom-ai

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

arize-phoenix-sqlean

AI Observability & Evaluation

llm-guard

The Security Toolkit for LLM Interactions

promptlayer

🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.

judgeval

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

promptflow-tracing

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-core

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

codeboxapi

👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.

promptflow-devkit

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

bitranox-skills

Claude Code plugin marketplace: the bitranox skill collection (82 skills) plus a self-improve Stop hook. Skills invoke as /bitranox:<skill>.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

ell-ai

A language model programming library.

mcp-contextforge-gateway

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.