Experiment Design Python Packages

ambrosia

Ambrosia is a Python library for A/B tests design, split and result measurement

groundwork-research

Groundwork for AI research agents: the complete pipeline from a direction to a submission — with the one stage every other toolkit is missing, a gate that returns NO-GO. Four measurements before the first experiment, a pre-registration git can date, an archive of ten ways a direction dies. Claude Code / Codex / DeepSeek / Kimi. No dependencies.

geoexp

Geo-experiment design on top of augsynth-py: market selection, power-based design ranking, and experiment reporting

adopy

Adaptive Design Optimization for Experimental Tasks

malet

Hyperparameter search and metric visualization tool for personal research.

repype

Reproducible, efficient, flexible batch processing using pipelines for sustainable software experiments

axopy

A Python Library for Implementing Human-Computer Interface Experiments

pystematic

Lightweight python experiment tracker.

kolmogorov-abacus

ABacus: fast hypothesis testing and experiment design solution

ambrozia

Ambrosia is a Python library for A/B tests design, split and result measurement

labphew

a minimalist functioning code module and folder structure, built to teach and exercise with computer-controlled measurements using Python.

exp-runner

exp-runner: Simple and extensible Python framework for data analysis and machine learning experiments