An Empirical Analysis of the Shift and Scale Parameters in BatchNorm

Yashna Peerthum, Mark Stamp

Batch Normalization (BatchNorm) is a technique that improves the training of deep neural networks, especially Convolutional Neural Networks (CNN). It has been empirically demonstra…