Global Convergence and Stability of Stochastic Gradient Descent

Vivak Patel, Shushu Zhang, Bowen Tian

In machine learning, stochastic gradient descent (SGD) is widely deployed to train models using highly non-convex objectives with equally complex noise models. Unfortunately, SGD t…