adamw
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
Sparse Curvature-Aware Adaptive Optimizer — second-order training at near-AdamW cost
Nadir: Cutting-edge PyTorch optimizers for simplicity & composability! 🔥🚀💻