67 citations · 221 across the 19 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018★ 51 cited
Towards Understanding Regularization in Batch Normalization
Ping Luo, Xinjiang Wang, Wenqi Shao +1
Batch Normalization (BN) improves both convergence and generalization in training neural networks. This work understands these phenomena theoretically. We analyze BN by using a bas…
cs.CV2018★ 21 cited
Batch Kalman Normalization: Towards Training Deep Neural Networks with Micro-Batches
Guangrun Wang, Jiefeng Peng, Ping Luo +2
As an indispensable component, Batch Normalization (BN) has successfully improved the training of deep neural networks (DNNs) with mini-batches, by normalizing the distribution of…