Second Order Optimization Python Packages

kron-torch

An implementation of PSGD Kron second-order optimizer for PyTorch

pyhessian

PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks

torchzero

Modular optimization library for PyTorch (work-in-progress).

psgd-jax

Implementation of PSGD optimizer in JAX

optami

This package is dedicated to high-order optimization methods. All the methods can be used similarly to standard PyTorch optimizers.

python-somax

Composable Second-Order Optimization for JAX and Optax.