Last-Iterate Convergence of Clipped SGD with Linear Decay

Wei Jiang, Haomin Bai, Zechao Li

In this paper, we study the last-iterate convergence of clipped stochastic gradient descent under heavy-tailed noise. We assume that the stochastic gradients are unbiased and that…