Regularization of Deep Neural Networks with Spectral Dropout

Salman Khan, Munawar Hayat, Fatih Porikli

The big breakthrough on the ImageNet challenge in 2012 was partially due to the `dropout' technique used to avoid overfitting. Here, we introduce a new approach called `Spectral Dr…