47 citations · 201 across the 15 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.LG2017
Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates
Leslie N. Smith, Nicholay Topin
In this paper, we describe a phenomenon, which we named "super-convergence", where neural networks can be trained an order of magnitude faster than with standard training methods.…
cs.LG2017★ 18 cited
Exploring loss function topology with cyclical learning rates
Leslie N. Smith, Nicholay Topin
We present observations and discussion of previously unreported phenomena discovered while training residual networks. The goal of this work is to better understand the nature of n…