Accelerated Gradient Descent by Concatenation of Stepsize Schedules

Zehao Zhang, Rujun Jiang

This work considers stepsize schedules for gradient descent on smooth convex objectives. We extend the existing literature and propose a unified technique for constructing stepsize…