8bit-optimizer
Memory-efficient PyTorch optimizers with Adaptive Log-Space quantization, fused CUDA kernels, and Adafactor, CAME, APOLLO support.
Zero-memory, multi-core-CPU local AI training for ordinary laptops.