Dual Averaging Converges for Nonconvex Smooth Stochastic Optimization

Tuo Liu, El Mehdi Saad, Wojciech Kotłowski +1

Dual averaging and gradient descent with their stochastic variants stand as the two canonical recipe books for first-order optimization: Every modern variant can be viewed as a des…