9.4k citations · 11.7k across the 21 of their papers we have counts for
Showing 2015Show all
2 papers · 1 filter
cs.LG2015★ 167 cited
Online Batch Selection for Faster Training of Neural Networks
Ilya Loshchilov, Frank Hutter
Deep neural networks are commonly trained using stochastic non-convex optimization procedures, which are driven by gradient information estimated on fractions (batches) of the data…
cs.NE2015
LM-CMA: an Alternative to L-BFGS for Large Scale Black-box Optimization
Ilya Loshchilov
The limited memory BFGS method (L-BFGS) of Liu and Nocedal (1989) is often considered to be the method of choice for continuous optimization when first- and/or second- order inform…