Optimizing the Efficiency of First-Order Methods for Decreasing the Gradient of Smooth Convex Functions

Donghwan Kim, Jeffrey A. Fessler

This paper optimizes the step coefficients of first-order methods for smooth convex minimization in terms of the worst-case convergence bound (i.e., efficiency) of the decrease in…