Ml Evaluation Python Packages

mcpbr

Benchmark your MCP server.

falsify

Fix the pass bar before the test runs. PRML is an open spec and CLI that hashes and timestamps evaluation criteria (SHA-256, RFC 3161) so anyone can check them later. Python, JS, Go, Rust.

falsify-inspect

PRML pre-registration adapter for Inspect AI eval logs. Listed on the UK AI Safety Institute's Inspect extensions page. MIT.

mlflow-falsify

Fix the pass bar before the test runs. PRML is an open spec and CLI that hashes and timestamps evaluation criteria (SHA-256, RFC 3161) so anyone can check them later. Python, JS, Go, Rust.

falsify-giskard

PRML pre-registration for Giskard scenario results: commit an eval claim to a SHA-256 before the run, then verify the result against it.

robometric-frame

TorchMetrics-based evaluation metrics for robotics policies and robot learning