agent-eval
CLI and Python library for lexical stability checks on repeated short agent outputs: pairwise exact agreement, token overlap, divergence point, and an order-independent score. Zero runtime dependencies.
Detect pytest config-leakage that corrupts agent-benchmark grading. Deterministic, no-LLM. Catches the VulcanBench --cov addopts mis-scoring bug.