LRTuner: A Learning Rate Tuner for Deep Neural Networks

Nikhil Iyer, V Thejas, Nipun Kwatra +2

One very important hyperparameter for training deep neural networks is the learning rate schedule of the optimizer. The choice of learning rate schedule determines the computationa…