Positional Normalization

Boyi Li, Felix Wu, Kilian Q. Weinberger +1

A popular method to reduce the training time of deep neural networks is to normalize activations at each layer. Although various normalization schemes have been proposed, they all…