Generalization and Stability of Interpolating Neural Networks with Minimal Width

Hossein Taheri, Christos Thrampoulidis

We investigate the generalization and optimization properties of shallow neural-network classifiers trained by gradient descent in the interpolating regime. Specifically, in a real…