3.7k citations
- Meta (United States)US158 papers
- New York UniversityUS11 papers
- Carnegie Mellon UniversityUS10 papers
- University of California, BerkeleyUS8 papers
- Stanford UniversityUS7 papers
- University of WashingtonUS7 papers
- Cornell UniversityUS6 papers
- University of OxfordGB6 papers
- Massachusetts Institute of TechnologyUS5 papers
- Meta (Israel)IL5 papers
- ETH ZurichCH4 papers
- Google (United States)US4 papers
Showing 2018 · stat.MLShow all
2 papers · 2 filters
stat.ML2018★ 50 cited
On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length
Stanisław Jastrzębski, Zachary Kenton, Nicolas Ballas +3
Stochastic Gradient Descent (SGD) based training of neural networks with a large learning rate or a small batch-size typically ends in well-generalizing, flat regions of the weight…
stat.ML2018★ 3 cited
Practical Transfer Learning for Bayesian Optimization
Matthias Feurer, Benjamin Letham, Frank Hutter +1
When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We…