L1-Norm Batch Normalization for Efficient Training of Deep Neural Networks

Shuang Wu, Guoqi Li, Lei Deng +3

Batch Normalization (BN) has been proven to be quite effective at accelerating and improving the training of deep neural networks (DNNs). However, BN brings additional computation,…