Effect of Various Regularizers on Model Complexities of Neural Networks in Presence of Input Noise

Mayank Sharma, Aayush Yadav, Sumit Soman +1

Deep neural networks are over-parameterized, which implies that the number of parameters are much larger than the number of samples used to train the network. Even in such a regime…