On the Iterate Convergence of AdaGrad for Generalized Smooth Convex Optimization

Mathieu Besançon, Tung Quoc Le

We prove sequential convergence results for the AdaGrad algorithm family optimizing convex differentiable objectives. Specifically, we provide necessary and sufficient conditions f…