Cross Validation Python Packages

iterative-stratification

scikit-learn cross validators for iterative stratification of multilabel data

sklearndf

DataFrame support for scikit-learn.

purgedcv

scikit-learn-compatible time-series cross-validation: purging, embargo, combinatorial purged CV, and deflated Sharpe ratios

timebasedcv

Time based splits for cross validation

ml4t-diagnostic

Signal diagnostics, statistical validation, and backtest evaluation for quantitative trading workflows.

autoreject

Automated rejection and repair of bad trials/sensors in M/EEG

sklearn-genetic-opt

Hyperparameter optimization and feature selection for scikit-learn using evolutionary algorithms. A modern alternative to GridSearchCV and RandomizedSearchCV.

osprey

🦅Hyperparameter optimization for machine learning pipelines 🦅

panelsplit

A tool for performing cross-validation with panel data

omega-lock

Catch overfitting before you ship it: a walk-forward / held-out gate for any optimizer (Optuna, sweeps, prompt search). The highest score isn't deployable until it survives data it never saw. CLI + Python.

hivmind-mlforge

Reproducible ML training, benchmarking, cross-validation, artifacts, and inference for Python.

spatial-kfold

spatial resampling for more robust cross validation in spatial studies

safesplit

Leakage-safe train/test splits — group-aware, time-aware, sequence-aware (homology), de-duplicated. The companion that prevents what LeakHound detects.

tscv

Time Series Cross-Validation -- an extension for scikit-learn

cv-reality-check

Why your CV is lying to you

lazygrid

Automatic, efficient and flexible implementation of complex machine learning pipeline generation and cross-validation.

neuropredict

Easy and comprehensive assessment of predictive power, with support for neuroimaging features

pychemometrics

pyChemometrics - Objects for multivariate analysis of chemometric and metabonomic datasets

t1-t2-protocol

MCP server for heterogeneous AI validation — T1 structured reasoning, T2 cross-model evaluation, and deterministic checksum. Python stdlib-only.

octopus-ml

A collection of handy ML and data visualization and validation tools. Go ahead and train, evaluate and validate your ML models and data with minimal effort.

utipy

Python utilities, e.g. for pandas

datatap

Focus on Algorithm Design, Not on Data Wrangling

nlptoolkit-sampling

Data sampling library

temporalcv

Temporal cross-validation for time series