2 papers
cs.DC2026
Co-Fabric: Breaking Host-Domain Boundaries for Unified xPU Interconnection
Zhen Peng, Jiaming Huang, Chaofan Chen +16
Large-model parameters have grown beyond the capacity of a single xPU, dispersing across multiple xPUs spanning distinct host domains, where xPU-to-xPU communication dominates over…
cs.NI2024
Rina: Enhancing Ring-AllReduce with In-network Aggregation in Distributed Model Training
Zixuan Chen, Xuandong Liu, Minglin Li +7
Parameter Server (PS) and Ring-AllReduce (RAR) are two widely utilized synchronization architectures in multi-worker Deep Learning (DL), also referred to as Distributed Deep Learni…