Counterbalancing Teacher: Regularizing Batch Normalized Models for Robustness

Saeid Asgari Taghanaki, Ali Gholami, Fereshte Khani +4

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN co…