Restructuring Batch Normalization to Accelerate CNN Training

Wonkyung Jung, Daejin Jung, and Byeongho Kim +3

Batch Normalization (BN) has become a core design block of modern Convolutional Neural Networks (CNNs). A typical modern CNN has a large number of BN layers in its lean and deep ar…