Adam Optimizer Python Packages

adv-optm

A family of highly efficient, lightweight yet powerful optimizers.

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

networks

Library which can be used to build feed forward NN, Convolutional Nets, Linear Regression, and Logistic Regression Models.

grams-pytorch

"Grams: Gradient Descent with Adaptive Momentum Scaling" implementation.

metaperceptron

MetaPerceptron: A Standardized Framework For Metaheuristic-Driven Multi-layer Perceptron Optimization

nadir

Nadir: Cutting-edge PyTorch optimizers for simplicity & composability! 🔥🚀💻

dlfs

Implementation from scratch (using numpy arrays) of a framework based on keras interface which allows to build and train Fully Connected Networks and Convolutional Neural Networks (CNNs).

relativistic-adam

A PyTorch optimizer that implements a relativistic gradient clipping mechanism, inspired by the theory of special relativity