single-gpu
verl for a single consumer GPU. PPO, GRPO and on-policy distillation on NVIDIA GPUs.
Autonomous research stack for continuously improving LLM training through automated experimentation. Single-GPU research labs. Karpathy-inspired.