Hypothesis Testing Python Packages

statsmodels

Statsmodels: statistical modeling and econometrics in Python

pandera

A light-weight, flexible, and expressive statistical data testing library

hyppo

Python package for multivariate hypothesis testing

distfit

distfit is a python library for probability density fitting.

d8s-hypothesis

Democritus functions for working with Hypothesis (https://hypothesis.readthedocs.io/en/latest/).

gnosislab

A scientific-method runtime for AI agents: hypotheses, experiments, evidence, provenance, reproducibility, and auditable conclusions.

scitex-stats

Statistical testing framework — 23 tests, effect sizes, power analysis

satvu

Lightweight API Client SDK for interacting with SatVu's APIs

simjecture

Evidence-governed autonomous experimentation and falsification for computational science

rhesis

The collaboration layer for AI teams: domain experts annotate and review agent behavior, engineers improve the agent from what they find.

rhesis-sdk

The collaboration layer for AI teams: domain experts annotate and review agent behavior, engineers improve the agent from what they find.

fieldtrial

Statistically rigorous real-world evaluation for robot policies. Plan how many rollouts you need, run them randomized and blinded from a phone at the robot, let fieldtrial switch LeRobot or openpi policies itself, and get a report that only says "better" when a pre-registered test does.

awesomepkf

Python library for pairwise Kalman filtering and smoothing on Gaussian pairwise Markov models: linear PKF, nonlinear EPKF/UPKF/PPF, six equivalent linear smoothers, EM learning and back-action tests. Reference code for two companion papers.

bayesprop

Bayesian A/B Testing for Proportions

tokio-ai

Is your backtest real? Deflated Sharpe Ratio, backtest-overfitting (PBO) and lookahead checks with measured false-positive rates. Works with vectorbt, backtesting.py and TradingView.

hypors

Hypothesis Testing in Rust, with Python bindings

rigor-mcp

Verified statistical inference for AI agents -- classical and non-parametric hypothesis testing, correlation/regression, effect sizes, power/sample-size, multiple-comparisons correction, a test-recommendation helper, and a batch pairwise-comparison tool, as a CLI and an MCP server

rft1d

One-Dimensional Random Field Theory in Python

copent

Estimating Copula Entropy (Mutual Information), Transfer Entropy (Conditional Mutual Information), and the statistics for multivariate normality test and two-sample test, and change point detection in Python

skyllh

The SkyLLH framework is an open-source Python3-based package licensed under the GPLv3 license. It provides a modular framework for implementing custom likelihood functions and executing log-likelihood ratio hypothesis tests. The idea is to provide a class structure tied to the mathematical objects of the likelihood functions.

deepsig

Enabling easy statistical significance testing for deep neural networks.

hypothesize

Robust statistics in Python

qube2

Community version of quantitative backtesting framework

jsharpe

Statistical inference for Sharpe ratios: probabilistic Sharpe ratio, minimum track record length, and FDR/FWER corrections for screening many strategies