Agent Benchmark Python Packages

evalview

Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.

journeyman-bench

A process-quality benchmark for LLM agents: it grades how an agent worked, not whether it passed — and every LLM-as-a-judge sits a calibrated exam before it may score.

nasde-toolkit

CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.

tracecore

Deterministic runtime for agent evaluation

codejoust

Pit AI coding agents against the same bug. Score them on tests, diff, cost, and time — pick the winning patch.