1 paper
Zhen Peng, Jiaming Huang, Chaofan Chen +16
Large-model parameters have grown beyond the capacity of a single xPU, dispersing across multiple xPUs spanning distinct host domains, where xPU-to-xPU communication dominates over…