16 citations · 34 across the 7 of their papers we have counts for
Showing 2018Show all
3 papers · 1 filter
cs.CV2018
Do Normalization Layers in a Deep ConvNet Really Need to Be Distinct?
Ping Luo, Zhanglin Peng, Jiamin Ren +1
Yes, they do. This work investigates a perspective for deep learning: whether different normalization layers in a ConvNet require different normalizers. This is the first step towa…
cs.LG2018
Towards Understanding Regularization in Batch Normalization
Ping Luo, Xinjiang Wang, Wenqi Shao +1
Batch Normalization (BN) improves both convergence and generalization in training neural networks. This work understands these phenomena theoretically. We analyze BN by using a bas…
cs.CV2018
Differentiable Learning-to-Normalize via Switchable Normalization
Ping Luo, Jiamin Ren, Zhanglin Peng +2
We address a learning-to-normalize problem by proposing Switchable Normalization (SN), which learns to select different normalizers for different normalization layers of a deep neu…