400 citations · 412 across the 2 of their papers we have counts for
2 papers
stat.ML2015★ 12 cited
Early Stopping is Nonparametric Variational Inference
Dougal Maclaurin, David Duvenaud, Ryan P. Adams
We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distri…
stat.ML2015★ 400 cited
Gradient-based Hyperparameter Optimization through Reversible Learning
Dougal Maclaurin, David Duvenaud, Ryan P. Adams
Tuning hyperparameters of learning algorithms is hard because gradients are usually unavailable. We compute exact gradients of cross-validation performance with respect to all hype…