Convergence of first-order methods via the convex conjugate

Javier Pena

This paper gives a unified and succinct approach to the $O(1/\sqrt{k}),O(1/k),$ and $O(1/k^2)$ convergence rates of the subgradient, gradient, and accelerated gradient methods for…