29 citations · 56 across the 3 of their papers we have counts for
3 papers
cs.DC2020★ 29 cited
DAPPLE: A Pipelined Data Parallel Approach for Training Large Models
Shiqing Fan, Yi Rong, Chen Meng +10
It is a challenging task to train large DNN models on sophisticated GPU platforms with diversified interconnect capabilities. Recently, pipelined training has been proposed as an e…
cs.PF2019★ 5 cited
Characterizing Deep Learning Training Workloads on Alibaba-PAI
Mengdi Wang, Chen Meng, Guoping Long +4
Modern deep learning models have been exploited in various domains, including computer vision (CV), natural language processing (NLP), search and recommendation. In practical AI cl…
cs.LG2019★ 22 cited
DL2: A Deep Learning-driven Scheduler for Deep Learning Clusters
Yanghua Peng, Yixin Bao, Yangrui Chen +3
More and more companies have deployed machine learning (ML) clusters, where deep learning (DL) models are trained for providing various AI-driven services. Efficient resource sched…