Observability Python Packages

langsmith

LangSmith Client SDK Implementations

ddtrace

Datadog Python APM Client

mlflow-skinny

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow-tracing

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

logfire

AI observability platform for production LLM and agent systems.

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

nemo-relay

Multi-language agent runtime and library for execution scope management, lifecycle events, and middleware on tool and LLM calls.

opentelemetry-instrumentation-anthropic

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-langchain

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-openai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-vertexai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

prefect-aws

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

opentelemetry-instrumentation-google-generativeai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-bedrock

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-crewai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-qdrant

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-cohere

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-llamaindex

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-ollama

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-transformers

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-replicate

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-watsonx

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-weaviate

Open-source observability for your GenAI or LLM application, based on OpenTelemetry