activity
20112023
most citedDecoupled Weight Decay Regularization

9.4k citations · 16.5k across the 107 of their papers we have counts for

collaborators
Showing 2021Show all

17 papers · 1 filter

cs.LG2021★ 25 cited

Transformers Can Do Bayesian Inference

Samuel Müller, Noah Hollmann, Sebastian Pineda Arango +2

Currently, it is hard to reap the benefits of deep learning for Bayesian methods, which allow the explicit specification of prior knowledge and accurately capture model uncertainty…

cs.LG2021

NAS-Bench-x11 and the Power of Learning Curves

Shen Yan, Colin White, Yash Savani +1

While early research in neural architecture search (NAS) required extreme computational resources, the recent releases of tabular and surrogate benchmarks have greatly increased th…

cs.LG2021★ 3 cited

CARL: A Benchmark for Contextual and Adaptive Reinforcement Learning

Carolin Benjamins, Theresa Eimer, Frederik Schubert +4

While Reinforcement Learning has made great strides towards solving ever more complicated tasks, many algorithms are still brittle to even slight changes in their environment. This…

cs.LG2021★ 83 cited

SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization

Marius Lindauer, Katharina Eggensperger, Matthias Feurer +6

Algorithm parameters, in particular hyperparameters of machine learning algorithms, can substantially impact their performance. To support users in determining well-performing hype…

cs.LG2021★ 9 cited

HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO

Katharina Eggensperger, Philipp Müller, Neeratyoy Mallik +6

To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial component of machine learning and its applications. Over the last years, the number of effici…

cs.LG2021

Multi-headed Neural Ensemble Search

Ashwin Raaghav Narayanan, Arber Zela, Tonmoy Saikia +2

Ensembles of CNN models trained with different seeds (also known as Deep Ensembles) are known to achieve superior performance over a single copy of the CNN. Neural Ensemble Search…