High Probability Convergence of Stochastic Gradient Methods

Zijian Liu, Ta Duy Nguyen, Thien Hang Nguyen +2

In this work, we describe a generic approach to show convergence with high probability for both stochastic convex and non-convex optimization with sub-Gaussian noise. In previous w…