Learning Rate Python Packages

torch-lr-finder

A learning rate range test implementation in PyTorch

efficient-polling-lr-scheduler

This repository replicates the Polling Method of Tan et al. on CIFAR-10 and introduces Efficient Polling, a novel extension that recovers the same learning-rate schedule — and almost the same accuracy — while polling only 5% of batches, cutting optimizer steps by 75% and per-epoch wall-clock time by 3.3×.

fir1

FIR & LMS filter implementation in C++ with Python & JAVA wrappers

lrsched

Framework-agnostic learning-rate schedules as pure functions, in Python with zero dependencies.

keras-lr-multiplier

Learning rate multiplier

warmup-scheduler-pytorch

A Warmup Scheduler for Pytorch to achieve the warmup learning rate at the beginning of training.

pytorch-scheduler

A comprehensive, research-driven collection of learning rate schedulers for PyTorch — 17 schedulers, composable warmup, opinionated presets, and first-class paper references.

salsa-optimizer

SaLSa Optimizer implementation (No learning rates needed)