57 citations · 57 across the 2 of their papers we have counts for
2 papers
cs.DC2024
Revisiting the Time Cost Model of AllReduce
Dian Xiong, Li Chen, Youhe Jiang +3
AllReduce is an important and popular collective communication primitive, which has been widely used in areas such as distributed machine learning and high performance computing. T…
cs.LG2022★ 57 cited
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism
Xupeng Miao, Yujie Wang, Youhe Jiang +4
Transformer models have achieved state-of-the-art performance on various domains of applications and gradually becomes the foundations of the advanced large deep learning (DL) mode…