AutoLR: An Evolutionary Approach to Learning Rate Policies

Pedro Carvalho, Nuno Lourenço, Filipe Assunção +1

The choice of a proper learning rate is paramount for good Artificial Neural Network training and performance. In the past, one had to rely on experience and trial-and-error to fin…