Sgd Python Packages

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

pyrddlgym-jax

JAX compilation of RDDL description files, and a differentiable planner in JAX.

nfnets-pytorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

zij

A canon of deep learning optimizers.

decopt

In compressed decentralized optimization settings, there are benefits to having multiple gossip steps between subsequent gradient iterations, even when the cost of doing so is appropriately accounted for e.g. by means of reducing the precision of compressed information.

keras-adamw

Keras implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

sgd-rest

Saccharomyces Genome Database (SGD) REST API wrapper

pytorch-swats

Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.