Neural Networks and Polynomial Regression. Demystifying the Overparametrization Phenomena

Matt Emschwiller, David Gamarnik, Eren C. Kızıldağ +1

In the context of neural network models, overparametrization refers to the phenomena whereby these models appear to generalize well on the unseen data, even though the number of pa…