Anytime Acceleration of Gradient Descent

Zihan Zhang, Jason D. Lee, Simon S. Du +1

This work investigates stepsize-based acceleration of gradient descent with {\em anytime} convergence guarantees. For smooth (non-strongly) convex optimization, we propose a stepsi…