104 citations · 282 across the 16 of their papers we have counts for
12 papers · 1 filter
TACTICL: Task-Aware Compression of Tabular ICL Models
Mykhailo Koshil, Matthias Feurer, Katharina Eggensperger
The strong performance of foundation models for tabular tasks comes at substantial inference costs. Distilling models into task-specific architectures reduces model size and comput…
carps: A Framework for Comparing N Hyperparameter Optimizers on M Benchmarks
Carolin Benjamins, Helena Graf, Sarah Segel +14
Hyperparameter Optimization (HPO) is crucial to develop well-performing machine learning models. In order to ease prototyping and benchmarking of HPO methods, we propose carps, a b…
Position: Why We Must Rethink Empirical Research in Machine Learning
Moritz Herrmann, F. Julian D. Lange, Katharina Eggensperger +7
We warn against a common but incomplete understanding of empirical research in machine learning that leads to non-replicable results, makes findings unreliable, and threatens to un…
Mind the Gap: Measuring Generalization Performance Across Multiple Objectives
Matthias Feurer, Katharina Eggensperger, Edward Bergman +3
Modern machine learning models are often constructed taking into account multiple objectives, e.g., minimizing inference time while also maximizing accuracy. Multi-objective hyperp…
TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second
Noah Hollmann, Samuel Müller, Katharina Eggensperger +1
We present TabPFN, a trained Transformer that can do supervised classification for small tabular datasets in less than a second, needs no hyperparameter tuning and is competitive w…
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization
Marius Lindauer, Katharina Eggensperger, Matthias Feurer +6
Algorithm parameters, in particular hyperparameters of machine learning algorithms, can substantially impact their performance. To support users in determining well-performing hype…
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO
Katharina Eggensperger, Philipp Müller, Neeratyoy Mallik +6
To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial component of machine learning and its applications. Over the last years, the number of effici…
Squirrel: A Switching Hyperparameter Optimizer
Noor Awad, Gresa Shala, Difan Deng +9
In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach swit…
Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning
Matthias Feurer, Katharina Eggensperger, Stefan Falkner +2
Automated Machine Learning (AutoML) supports practitioners and researchers with the tedious task of designing machine learning pipelines and has recently achieved substantial succe…
Towards Assessing the Impact of Bayesian Optimization's Own Hyperparameters
Marius Lindauer, Matthias Feurer, Katharina Eggensperger +2
Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well…
BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters
Marius Lindauer, Katharina Eggensperger, Matthias Feurer +4
Hyperparameter optimization and neural architecture search can become prohibitively expensive for regular black-box Bayesian optimization because the training and evaluation of a s…
Deep learning with convolutional neural networks for decoding and visualization of EEG pathology
Robin Tibor Schirrmeister, Lukas Gemein, Katharina Eggensperger +2
We apply convolutional neural networks (ConvNets) to the task of distinguishing pathological from normal EEG recordings in the Temple University Hospital EEG Abnormal Corpus. We us…