Batch Kalman Normalization: Towards Training Deep Neural Networks with Micro-Batches

Guangrun Wang, Jiefeng Peng, Ping Luo +2

As an indispensable component, Batch Normalization (BN) has successfully improved the training of deep neural networks (DNNs) with mini-batches, by normalizing the distribution of…