9.4k citations · 16.5k across the 107 of their papers we have counts for
Showing 2016 · cs.LGShow all
2 papers · 2 filters
cs.LG2016★ 1.7k cited
SGDR: Stochastic Gradient Descent with Warm Restarts
Ilya Loshchilov, Frank Hutter
Restart techniques are common in gradient-free optimization to deal with multimodal functions. Partial warm restarts are also gaining popularity in gradient-based optimization to i…
cs.LG2016★ 137 cited
Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets
Aaron Klein, Stefan Falkner, Simon Bartels +2
Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite…