Extension of the safeguarding stepsize interval in Adaptive Gradient Descent

Saneatsu Kagawa, Nobuo Yamashita

In this paper, inspired by the idea of Adaptive Gradient Descent (AdGD) by Malitsky and Mishchenko, we propose a method that adaptively provides a stepsize interval, which represen…