Quadratic number of nodes is sufficient to learn a dataset via gradient descent

Biswarup Das, Eugene. A. Golikov

We prove that if an activation function satisfies some mild conditions and number of neurons in a two-layered fully connected neural network with this activation function is beyond…