Training of deep residual networks with stochastic MG/OPT

Cyrill von Planta, Alena Kopanicakova, Rolf Krause

We train deep residual networks with a stochastic variant of the nonlinear multigrid method MG/OPT. To build the multilevel hierarchy, we use the dynamical systems viewpoint specif…