GPU-Initiated Networking for NCCL

Khaled Hamidouche, John Bachan, Pak Markthub +6

Modern AI workloads, especially Mixture-of-Experts (MoE) architectures, increasingly demand low-latency, fine-grained GPU-to-GPU communication with device-side control. Traditional…