Regression Detection Python Packages

calibrax

Unified benchmarking and profiling framework for the JAX scientific ML ecosystem. Timing, GPU/energy monitoring, FLOPS counting, roofline analysis, statistical testing, regression detection, and CI integration.

openclaw-upgrade-orchestrator-mcp

MCP server for safe AI agent runtime upgrades — version-aware regression catalog, pre/post snapshot diff, rollback guides. Read-only advisor: never executes upgrades. Bring your own catalog for non-OpenClaw runtimes.

kalibra

Statistical regression detection and CI quality gates for AI agents

llmtestr

A new package that helps developers integration-test AI and LLM applications by validating structured outputs. It takes a user's test scenario or prompt as input, sends it to an LLM, and uses pattern

pytest-agent-health

Catch silent agent failures in CI. Pytest plugin with regression detection for LLM agents.