Stepsize Hedging: an Alternative Mechanism for Accelerating Gradient Descent
arXiv:2605.31386
Abstract
Can gradient descent be accelerated by just choosing better stepsizes? Surprisingly, the answer is yes. This short expository article provides an accessible introduction to this phenomenon of stepsize hedging.
to appear as an invited Research Highlight in the 2026 INFORMS Computing Society Newsletter