collective-communication
Decoupled, communication stack for the scale-up domain.
Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66-2.17x over torch.distributed on NVLink.
Audit GPU cluster communication schedules from NCCL logs. Zero dependencies. CI-ready.
