The Loss Surface of Residual Networks: Ensembles and the Role of Batch Normalization

Etai Littwin, Lior Wolf

Deep Residual Networks present a premium in performance in comparison to conventional networks of the same depth and are trainable at extreme depths. It has recently been shown tha…