Sgd Python Packages

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

nfnets-pytorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

decopt

In compressed decentralized optimization settings, there are benefits to having multiple gossip steps between subsequent gradient iterations, even when the cost of doing so is appropriately accounted for e.g. by means of reducing the precision of compressed information.

pyrddlgym-jax

JAX compilation of RDDL description files, and a differentiable planner in JAX.

keras-adamw

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

sgd-rest

Saccharomyces Genome Database (SGD) REST API wrapper

pytorch-swats

PyTorch implementation of SWATS algorithm.