Silver Rate Is (Almost) Optimal for Gradient Descent: The Strongly Convex Case

Kaizhao Liu, Yuhan Ye

We study gradient descent with predetermined nonnegative stepsizes on smooth strongly convex functions. Let $p_{\mathrm{sil}}={\log }_2(1+\sqrt{2})$ and $\kappa$ be the condition number. We…