A Learn-to-Optimize Approach for Coordinate-Wise Step Sizes for Quasi-Newton Methods

Wei Lin, Qingyu Song, Hong Xu

Tuning step sizes is crucial for the stability and efficiency of optimization algorithms. While adaptive coordinate-wise step sizes have been shown to outperform scalar step size i…