Showing math.OCShow all
2 papers · 1 filter
math.OC2026
Revisiting AdaGrad in Stochastic Convex Optimization: Last Iterates, High Probability, and Lower Bounds
Weiming Ou, Xiao Wang
AdaGrad and AdaGrad-Norm are widely used adaptive methods, but their precise behavior in stochastic convex optimization remains less understood. We first show that AdaGrad-Norm and…
math.OC2026
Tight Heavy-Tailed Complexity Bounds for Optimizing Polyak--Łojasiewicz Objectives
Weiming Ou, Xiao Wang
We study optimizing -smooth and -Polyak-Lojasiewicz (PL) objectives with unbiased stochastic gradients under -heavy-tailed noise (). In the unrestricted high-dim…