Gradient Descent Python Packages

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

networks

Library which can be used to build feed forward NN, Convolutional Nets, Linear Regression, and Logistic Regression Models.

neural-tangents

Fast and Easy Infinite Neural Networks in Python

torchzero

Modular optimization library for PyTorch (work-in-progress).

zij

A canon of deep learning optimizers.

spsa

A simple implementation of SPSA with automatic learning rate tuning

mlektic

A Python ML library to use and visualize gradient descent for linear and logistic regression optimization.

torchimize

numerical optimization in pytorch

grande

(ICLR 2024) GRANDE: Gradient-Based Decision Tree Ensembles

ml-python

The easiest way to do machine learning

nets

Recreating PyTorch from scratch, using Numpy. Supports FCN, CNN, RNN layers.

descent

First order optimization tools

fastcpd

Fast Change Point Detection

mlr-gd

Multiple linear regression by gradient descent.

torch-cgd

A fast implementation of adaptive competitive gradient descent in PyTorch 🤺

yodf

'Hello, World!' Forward Mode Autdiff library with Tensorflow 1 like interface.

waveletml

WaveletML: A Scalable and Extensible Wavelet Neural Network Framework

dlfs

Implementation from scratch (using numpy arrays) of a framework based on keras interface which allows to build and train Fully Connected Networks and Convolutional Neural Networks (CNNs).

simpliml

Machine Learning, Artificial Intelligence, Mathematics

tno-mpc-mpyc-secure-learning

TNO PET Lab - secure Multi-Party Computation (MPC) - MPyC - Secure Learning

gradient-equilibrum

Gradient Equillibrum - Pytorch

psd-optimizer

Perturbed Saddle-point Descent optimizer for PyTorch

findi-descent

FinDi: Finite Difference Gradient Descent can optimize any function, including the ones without analytic form, by employing finite difference numerical differentiation within a gradient descent algorithm.

optimisation-algorithms

A collection of the most commonly used Optimisation Algorithms for Data Science & Machine Learning