Theoretical Insight into Batch Normalization: Data Dependant Auto-Tuning of Regularization Rate

Lakshmi Annamalai, Chetan Singh Thakur

Batch normalization is widely used in deep learning to normalize intermediate activations. Deep networks suffer from notoriously increased training complexity, mandating careful in…