Ai Observability Python Packages

logfire

AI observability platform for production LLM and agent systems.

arize-phoenix

AI Observability & Evaluation

arize-phoenix-otel

AI Observability & Evaluation

openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

arize-phoenix-client

AI Observability & Evaluation

arize

A Python client to interact with Arize API

arize-phoenix-evals

AI Observability & Evaluation

trulens-core

Evaluation and Tracking for LLM Experiments and AI Agents

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-litellm

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-feedback

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-otel-semconv

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-eval

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-connectors-snowflake

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-cortex

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-openai

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-llamaindex

Evaluation and Tracking for LLM Experiments and AI Agents

stackunderflow

StackUnderflow: the local observability for your coding agents. Search, replay, and analyse every session, all offline. Starts with Claude Code.

trulens-providers-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

genai-otel-instrument

GenAI OpenTelemetry Auto-Instrumentation Library A comprehensive wrapper for automatic instrumentation of LLM/GenAI applications Supports all major LLM providers and MCP (Model Context Protocol) tool calls

trulens-providers-bedrock

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langgraph

Evaluation and Tracking for LLM Experiments and AI Agents