Distributed Training of Deep Neural Networks with Theoretical Analysis: Under SSP Setting

Abhimanu Kumar, Pengtao Xie, Junming Yin +1

We propose a distributed approach to train deep neural networks (DNNs), which has guaranteed convergence theoretically and great scalability empirically: close to 6 times faster on…