Staleness-aware Async-SGD for Distributed Deep Learning

Wei Zhang, Suyog Gupta, Xiangru Lian +1

Deep neural networks have been shown to achieve state-of-the-art performance in several machine learning tasks. Stochastic Gradient Descent (SGD) is the preferred optimization algo…