Learning Rate Optimization for Deep Neural Networks Using Lipschitz Bandits

Padma Priyanka, Sheetal Kalyani, Avhishek Chatterjee

Learning rate is a crucial parameter in training of neural networks. A properly tuned learning rate leads to faster training and higher test accuracy. In this paper, we propose a L…