Multilevel Initialization for Layer-Parallel Deep Neural Network Training

Eric C. Cyr, Stefanie Günther, Jacob B. Schroder

This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous in…