VarioPath: Workload-Aware All-to-All Communication for PCIe GPU Clusters

Yao Fei, Jin Fang, Size Zheng +4

AlltoAllv communication is a critical primitive in distributed large-model inference, particularly for mixture-of-experts (MoE) models. The growing adoption of PCIe GPU systems for…