Early Stopping Python Packages

substrax

JAX/Flax NNX training infrastructure: device meshes and SPMD sharding, an Orbax checkpoint store, early stopping and callbacks, W&B and MLflow logging.

loopgain

An open-source cost controller for AI agent loops — stops a loop when it's actually converged and rolls back before it degrades, instead of running to a fixed max_iterations cap. Real-time loop-gain (Aβ) bands + best-so-far rollback. Adapters for LangGraph, CrewAI, AutoGen, LangChain, OpenAI Agents, and Claude Agent SDK; raw API for custom stacks.

markov-kmeans

Early stopping for K-means: stop when only boundary points still switch clusters, and settle them from their own label history. Shorter runs, uncertainty flags, soft memberships. Exact Lloyd, mini-batch and EMA (constant-step) training. scikit-learn compatible.

certified-pruner

Stop bad runs early, with a conformal bound on how often you stop a good one

lightgbm-callbacks

A collection of LightGBM callbacks. (DART early stopping, tqdm progress bar)

surestop

Stop bad runs early, with a conformal bound on how often you stop a good one

traintools

Agent-ready PyTorch training diagnostics: gradient health, GNS, batch inspection, data quality, plasticity, and early stopping.

ftdoctor

Did your fine-tune overfit? Which checkpoint should you keep? What can you delete? For any HuggingFace Trainer run, local or on the Hub: TRL, Unsloth, LLaMA-Factory, Axolotl.

early-stopping-pytorch

Early stopping for PyTorch