37 citations · 75 across the 8 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018
Learning with Random Learning Rates
Léonard Blier, Pierre Wolinski, Yann Ollivier
Hyperparameter tuning is a bothersome step in the training of deep learning models. One of the most sensitive hyperparameters is the learning rate of the gradient descent. We prese…
cs.LG2018★ 37 cited
The Description Length of Deep Learning Models
Léonard Blier, Yann Ollivier
Solomonoff's general theory of inference and the Minimum Description Length principle formalize Occam's razor, and hold that a good model of data is a model that is good at lossles…