Learning sparse features can lead to overfitting in neural networks

Leonardo Petrini, Francesco Cagnetta, Eric Vanden-Eijnden +1

It is widely believed that the success of deep networks lies in their ability to learn a meaningful representation of the features of the data. Yet, understanding when and how this…