Sequential Testing Python Packages

fieldtrial

Statistically rigorous real-world evaluation for robot policies. Plan how many rollouts you need, run them randomized and blinded from a phone at the robot, let fieldtrial switch LeRobot or openpi policies itself, and get a report that only says "better" when a pre-registered test does.

bayesprop

Bayesian A/B Testing for Proportions

noisefloor

Source-aware research diagnostics, correlation spectra, forecasting and synthetic Dyson experiments. Python, CLI, REST and MCP.

dpsprt

Differentially private sequential probability ratio tests (Michel, Basu & Kaufmann, AISTATS 2026)

seqabpy

Sequential A/B Testing Framework in Python

experiment-toolkit

Small, well-tested Python package for online controlled experiments: sample size, CUPED, mSPRT sequential tests, delta-method ratio metrics.

splita

A/B test analysis that is correct by default, informative by design, and composable by construction. 88 classes, 60+ paper references.