Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise and Hölder Smoothness

Misbah Uz Zaman, Anirbit Mukherjee

Classical convergence guarantees for stochastic gradient methods typically assume Lipschitz-smooth objectives and finite-variance gradient noise, both frequently violated in practi…