deepspeed
Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
Application of the L2HMC algorithm to simulations in lattice QCD.
A lightweight post-training framework for LLMs and VLMs
Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Running Large Language Model easily, faster and low-cost.