A Practical Layer-Parallel Training Algorithm for Residual Networks

Qi Sun, Hexin Dong, Zewei Chen +5

Gradient-based algorithms for training ResNets typically require a forward pass of the input data, followed by back-propagating the objective gradient to update parameters, which a…