Revisiting Learning Rate Control

Micha Henheik, Theresa Eimer, Marius Lindauer

The learning rate is one of the most important hyperparameters in deep learning, and how to control it is an active area within both AutoML and deep learning research. Approaches f…