Polyak Stepsize: Estimating Optimal Functional Values Without Parameters or Prior Knowledge

Farshed Abdukhakimov, Cuong Anh Pham, Samuel Horváth +2

The Polyak stepsize for Gradient Descent is known for its fast convergence but requires prior knowledge of the optimal functional value, which is often unavailable in practice. In…