Ml Evaluation Python Packages

falsify

A single-file Python CLI that pre-registers AI/ML accuracy claims with SHA-256. Lock the threshold before the data, or it didn't happen.

mcpbr

Benchmark your MCP server.

falsify-inspect

PRML pre-registration adapter for Inspect AI eval logs. MIT.

mlflow-falsify

A single-file Python CLI that pre-registers AI/ML accuracy claims with SHA-256. Lock the threshold before the data, or it didn't happen.

falsify-giskard

PRML pre-registration for Giskard scenario results: commit an eval claim to a SHA-256 before the run, then verify the result against it.

robometric-frame

TorchMetrics-based evaluation metrics for robotics policies and robot learning