agent-evals
Measure the real-world error rate and dollar cost of an AI agent's decisions. OpenTelemetry-native.
The node-level tracing library for agentic software.
An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"
SWE-bench for your codebase. Turn merged PRs into reproducible coding-agent benchmarks.