Distributed Deep Learning using Stochastic Gradient Staleness

Viet Hoang Pham, Hyo-Sung Ahn

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substanti…