Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates

Jacob Portes, Davis Blalock, Cory Stephenson +1

Benchmarking the tradeoff between neural network accuracy and training time is computationally expensive. Here we show how a multiplicative cyclic learning rate schedule can be use…