Why Clipping Matters in AdaGrad? Toward a High-Probability Theory under Generalized Smoothness

Alokendu Mazumder, Ayaan Mohd, Harshit Rawat +3

We analyze the original same-step coordinate-wise AdaGrad under generalized smoothness and heavy-tailed noise with bounded variance. In this setting, local curvature may grow sub-q…