Experiments on Parallel Training of Deep Neural Network using Model Averaging

Hang Su, Haoyu Chen

In this work we apply model averaging to parallel training of deep neural network (DNN). Parallelization is done in a model averaging manner. Data is partitioned and distributed to…