Towards Weaker Variance Assumptions for Stochastic Optimization

Ahmet Alacaoglu, Yura Malitsky, Stephen J. Wright

We revisit a classical assumption for analyzing stochastic gradient algorithms where the squared norm of the stochastic subgradient (or the variance for smooth problems) is allowed…