Benign Overfitting for Regression with Trained Two-Layer ReLU Networks

Junhyung Park, Patrick Bloebaum, Shiva Prasad Kasiviswanathan

We study the least-square regression problem with a two-layer fully-connected neural network, with ReLU activation function, trained by gradient flow. Our first result is a general…