One-pass Stochastic Gradient Descent in Overparametrized Two-layer Neural Networks

Jiaming Xu, Hanjing Zhu

There has been a recent surge of interest in understanding the convergence of gradient descent (GD) and stochastic gradient descent (SGD) in overparameterized neural networks. Most…