Nonconvex optimization and convergence of stochastic gradient descent, and solution of asynchronous game

Kevin Buck, Jessica Babyak, Paolo Piersanti +3

We review convergence and behavior of stochastic gradient descent for convex and nonconvex optimization, establishing various conditions for convergence to zero of the variance of…