Llm Eval Python Packages

arize-phoenix-otel

AI Observability & Evaluation

arize-phoenix-client

AI Observability & Evaluation

arize-phoenix-evals

AI Observability & Evaluation

arize-phoenix

AI Observability & Evaluation

arize-phoenix-sqlean

AI Observability & Evaluation

trulens-core

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-feedback

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-otel-semconv

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-eval

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

trulens-connectors-snowflake

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-openai

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-litellm

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-llamaindex

Evaluation and Tracking for LLM Experiments and AI Agents

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

parea-ai

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

trulens-providers-cortex

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-bedrock

Evaluation and Tracking for LLM Experiments and AI Agents

decimalai

Python SDK for agent evals and skill routing — measure a skill's real lift before you trust it

trulens-providers-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

multivon-eval

Practical LLM evaluation for teams that ship to production. Deterministic + LLM-as-judge evaluators, dataset support, CI/CD integration.