Conjugate Gradients and Accelerated Methods Unified: The Approximate Duality Gap View

Jelena Diakonikolas, Lorenzo Orecchia

This note provides a novel, simple analysis of the method of conjugate gradients for the minimization of convex quadratic functions. In contrast with standard arguments, our proof…