Regularizing by the Variance of the Activations' Sample-Variances

Etai Littwin, Lior Wolf

Normalization techniques play an important role in supporting efficient and often more effective training of deep neural networks. While conventional methods explicitly normalize t…