GoSGD: Distributed Optimization for Deep Learning with Gossip Exchange

Michael Blot, David Picard, Matthieu Cord

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization…