Significance Testing Python Packages

hypothesize

A Python package for comparing groups and measuring associations using robust statistics.

siggate

The vendor-neutral significance gate for AI evals. Most eval tools show a number moving; siggate tells you — in CI — whether the move is statistically real or within noise.

deepsig

Enabling easy statistical significance testing for deep neural networks.

hera-matlab

HERA: Hierarchical-Compensatory, Effect-Size Driven Ranking Algorithm.

dnn-inference

Dnn-Inference is a Python module for hypothesis testing based on deep neural networks.

scatterbin

Adjustable binning of scatter plot data

robust-statistics-simulator

Robust statistics in Python

evalkit-research

Rigorous LLM evaluation: bootstrap CIs, significance testing, and automated statistical auditing