Decoding Generalization from Memorization in Deep Neural Networks

Simran Ketha, Venkatakrishnan Ramaswamy

Overparameterized deep networks that generalize well have been key to the dramatic success of deep learning in recent years. The reasons for their remarkable ability to generalize…