learning-rate-scheduling
Learning Rate Warmup in PyTorch
Episodic adaptive control for PyTorch optimizer dynamics.
ABEL implemented in PyTorch
Flexible parameter scheduler that can be implemented with proprietary and open source optimizers.
A learning rate recommending and benchmarking tool.