Sgd Python Packages

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

physfdt

Fluctuation–dissipation diagnostics for SGD: detects whether training has equilibrated at the current learning rate

pyrddlgym-jax

JAX compilation of RDDL description files, and a differentiable planner in JAX.

decopt

In compressed decentralized optimization settings, there are benefits to having multiple gossip steps between subsequent gradient iterations, even when the cost of doing so is appropriately accounted for e.g. by means of reducing the precision of compressed information.

nfnets-pytorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

sgd-rest

Saccharomyces Genome Database (SGD) REST API wrapper

keras-adamw

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

pytorch-swats

Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.

zij

A canon of deep learning optimizers.