Locally Asynchronous Stochastic Gradient Descent for Decentralised Deep Learning

Tomer Avidor, Nadav Tal Israel

Distributed training algorithms of deep neural networks show impressive convergence speedup properties on very large problems. However, they inherently suffer from communication re…