Agent Evaluation Python Packages

trulens-core

Evaluation and Tracking for LLM Experiments and AI Agents

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-litellm

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-feedback

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-otel-semconv

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-eval

Evaluation and Tracking for LLM Experiments and AI Agents

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

trulens-connectors-snowflake

Evaluation and Tracking for LLM Experiments and AI Agents

etzchaim

A diagnosable brain for your LLM. Cognitive architecture in the SOAR/ACT-R/CLARION/LIDA lineage, for the LLM era. Apache 2.0.

trulens-providers-cortex

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-openai

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-llamaindex

Evaluation and Tracking for LLM Experiments and AI Agents

any-agent

A single interface to use and evaluate different agent frameworks

trulens-providers-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-bedrock

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langgraph

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-huggingface

Evaluation and Tracking for LLM Experiments and AI Agents

evalview

Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.

trulens-benchmark

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-nemo

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-hotspots

Evaluation and Tracking for LLM Experiments and AI Agents

clawbench-eval

Open-source benchmark for browser AI agents on 153 everyday online tasks across 144 live websites. 5-layer recording + DOM-match + LLM judge. Top score 33.3%.