An adaptive framework for first-order gradient methods

Xiaozhe Hu, Sara Pollock, Zhongqin Xue +1

Gradient methods are widely used in optimization problems. In practice, while the smoothness parameter can be estimated utilizing techniques such as backtracking, estimating the st…