70 citations · 296 across the 39 of their papers we have counts for
Showing 2018 · cs.DCShow all
2 papers · 2 filters
cs.DC2018
MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms
Shaohuai Shi, Xiaowen Chu, Bo Li
Distributed synchronous stochastic gradient descent has been widely used to train deep neural networks on computer clusters. With the increase of computational power, network commu…
cs.DC2018
A DAG Model of Synchronous Stochastic Gradient Descent in Distributed Deep Learning
Shaohuai Shi, Qiang Wang, Xiaowen Chu +1
With huge amounts of training data, deep learning has made great breakthroughs in many artificial intelligence (AI) applications. However, such large-scale data sets present comput…