Accelerating Training of Deep Neural Networks with a Standardization Loss

Jasmine Collins, Johannes Balle, Jonathon Shlens

A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better…