Power Analysis Python Packages

scitex-stats

Statistical testing framework — 23 tests, effect sizes, power analysis

fieldtrial

Statistically rigorous real-world evaluation for robot policies. Plan how many rollouts you need, run them randomized and blinded from a phone at the robot, let fieldtrial switch LeRobot or openpi policies itself, and get a report that only says "better" when a pre-registered test does.

mcpower

Power analysis by simulation — any design from t-test to mixed models, in your browser, on your desktop, or in Python and R.

errorbars

Error bars for LLM evals: clustered SEs, paired comparisons, leaderboards, and power analysis. Python + web calculator.

geoexp

Geo-experiment design on top of augsynth-py: market selection, power-based design ranking, and experiment reporting

chipwhisperer-studio

Desktop app for ChipWhisperer side-channel and fault-injection hardware: live waveforms, capture, CPA, glitch sweeps, UART/SPI/JTAG/SWD interfaces, a logic analyser with protocol decoders, firmware code mapped onto the power trace, notebooks, one-click firmware builds and an MCP server for AI agents. Linux, Windows, macOS.

increment

Python library for warehouse-native A/B testing, causal inference, and experiment analysis

pilotr

pilotr: a cross-language toolkit for simulating experimental and behavioral data, with integrated power and design analysis

fast-exp-analytics

Python toolkit for A/B and A/B/C test analysis, confidence intervals, MDE and duration planning, Excel reports, and chat summaries.

recoverlite

Python mirror of recoverlite: pre-data recovery tests for planned study designs (protocol-identical to the R package; results agree within Monte Carlo error)

olspow

Python package for conducting power analysis for experiments using regression and/or clustered data.

powerbench

Statistical power analysis that shows its work: 27 designs, each checked against an independent simulation and external tools, with disagreements attributed rather than hidden.

questvar

QuEStVar as python package providing direct API/CLI access to hypothesting framework to expand statistical explainability via added equivalence testing.

cycling-stats

Calculate advanced cycling statistics from power and/or heart rate data