188 citations · 288 across the 20 of their papers we have counts for
Showing 2015Show all
2 papers · 1 filter
cs.LG2015★ 188 cited
Staleness-aware Async-SGD for Distributed Deep Learning
Wei Zhang, Suyog Gupta, Xiangru Lian +1
Deep neural networks have been shown to achieve state-of-the-art performance in several machine learning tasks. Stochastic Gradient Descent (SGD) is the preferred optimization algo…
stat.ML2015★ 9 cited
Model Accuracy and Runtime Tradeoff in Distributed Deep Learning:A Systematic Study
Suyog Gupta, Wei Zhang, Fei Wang
This paper presents Rudra, a parameter server based distributed computing framework tuned for training large-scale deep neural networks. Using variants of the asynchronous stochast…