Distributed stochastic optimization for deep learning (thesis)

Sixin Zhang

We study the problem of how to distribute the training of large-scale deep learning models in the parallel computing environment. We propose a new distributed stochastic optimizati…