QLABGrad: a Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning

Minghan Fu, Fang-Xiang Wu

The learning rate is a critical hyperparameter for deep learning tasks since it determines the extent to which the model parameters are updated during the learning course. However,…