How to Use Dropout Correctly on Residual Networks with Batch Normalization

Bum Jun Kim, Hyeyeon Choi, Hyeonah Jang +2

For the stable optimization of deep neural networks, regularization methods such as dropout and batch normalization have been used in various tasks. Nevertheless, the correct posit…