memory-efficient-training
Memory-efficient PyTorch optimizers with Adaptive Log-Space quantization, fused CUDA kernels, and Adafactor, CAME, APOLLO support.
Apache-2.0 clean-room implementation of APOLLO for memory-efficient full-parameter LLM training.
