Batch Normalization is a Cause of Adversarial Vulnerability

Angus Galloway, Anna Golubeva, Thomas Tanay +2

Batch normalization (batch norm) is often used in an attempt to stabilize and accelerate training in deep neural networks. In many cases it indeed decreases the number of parameter…