57 citations · 75 across the 26 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.DC2024
Revisiting the Time Cost Model of AllReduce
Dian Xiong, Li Chen, Youhe Jiang +3
AllReduce is an important and popular collective communication primitive, which has been widely used in areas such as distributed machine learning and high performance computing. T…
cs.DC2024★ 2 cited
HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware
Ran Yan, Youhe Jiang, Xiaonan Nie +3
Training large language models (LLMs) is a computationally intensive task, which is typically conducted in data centers with homogeneous high-performance GPUs. In this paper, we ex…