Sharp Initialization Guarantees for the Heavy-Ball Method

Kang Liu, Quanen Wu, Zhan Sun +3

The heavy-ball method can accelerate convergence near the minimizer, but it may also enter persistent oscillations on general strongly convex objectives. How should it be initializ…