ucx
Topology-aware GPU data infrastructure: fabric, columnar exchange, distributed runtime and query engine.
UCX-based torch.distributed backend with MPI-style tag-matched send/recv (NCCL ignores tags) and collectives on CPU & CUDA.