Significance Testing Python Packages

hypothesize

A Python package for comparing groups and measuring associations using robust statistics.

siggate

The vendor-neutral significance gate for AI evals: tells you in CI whether an eval improvement is statistically REAL or within noise. Open-core, powered by deltagate.

deepsig

Enabling easy statistical significance testing for deep neural networks.

hera-matlab

HERA: Hierarchical-Compensatory, Effect-Size Driven Ranking Algorithm.

dnn-inference

Dnn-Inference is a Python module for hypothesis testing based on deep neural networks.

scatterbin

Adjustable binning of scatter plot data

robust-statistics-simulator

Robust statistics in Python

evalkit-research

Rigorous LLM evaluation: bootstrap CIs, significance testing, and automated statistical auditing