How many Neurons do we need? A refined Analysis for Shallow Networks trained with Gradient Descent

Mike Nguyen, Nicole Mücke

We analyze the generalization properties of two-layer neural networks in the neural tangent kernel (NTK) regime, trained with gradient descent (GD). For early stopped GD we derive…