Batch normalization does not improve initialization

Joris Dannemann, Gero Junike

Batch normalization is one of the most important regularization techniques for neural networks, significantly improving training by centering the layers of the neural network. Ther…