195 citations · 248 across the 6 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2022★ 12 cited
MoESys: A Distributed and Efficient Mixture-of-Experts Training and Inference System for Internet Services
Dianhai Yu, Liang Shen, Hongxiang Hao +5
While modern internet services, such as chatbots, search engines, and online advertising, demand the use of large-scale deep neural networks (DNNs), distributed training and infere…
cs.DC2021
End-to-end Adaptive Distributed Training on PaddlePaddle
Yulong Ao, Zhihua Wu, Dianhai Yu +10
Distributed training has become a pervasive and effective approach for training a large neural network (NN) model with processing massive data. However, it is very challenging to s…