83 citations · 215 across the 19 of their papers we have counts for
15 papers · 1 filter
TACTICL: Task-Aware Compression of Tabular ICL Models
Mykhailo Koshil, Matthias Feurer, Katharina Eggensperger
The strong performance of foundation models for tabular tasks comes at substantial inference costs. Distilling models into task-specific architectures reduces model size and comput…
CASHomon Sets: Efficient Rashomon Sets Across Multiple Model Classes and their Hyperparameters
Fiona Katharina Ewald, Martin Binder, Matthias Feurer +2
Rashomon sets are model sets within one model class that perform nearly as well as a reference model from the same model class. They reveal the existence of alternative well-perfor…
carps: A Framework for Comparing N Hyperparameter Optimizers on M Benchmarks
Carolin Benjamins, Helena Graf, Sarah Segel +14
Hyperparameter Optimization (HPO) is crucial to develop well-performing machine learning models. In order to ease prototyping and benchmarking of HPO methods, we propose carps, a b…
Position: A Call to Action for a Human-Centered AutoML Paradigm
Marius Lindauer, Florian Karl, Anne Klier +6
Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML) workflows, aiding the research o…
Position: Why We Must Rethink Empirical Research in Machine Learning
Moritz Herrmann, F. Julian D. Lange, Katharina Eggensperger +7
We warn against a common but incomplete understanding of empirical research in machine learning that leads to non-replicable results, makes findings unreliable, and threatens to un…
Interpretable Machine Learning for TabPFN
David Rundel, Julius Kobialka, Constantin von Crailsheim +3
The recently developed Prior-Data Fitted Networks (PFNs) have shown very promising results for applications in low-data regimes. The TabPFN model, a special case of PFNs for tabula…
PFNs4BO: In-Context Learning for Bayesian Optimization
Samuel Müller, Matthias Feurer, Noah Hollmann +1
In this paper, we use Prior-data Fitted Networks (PFNs) as a flexible surrogate for Bayesian Optimization (BO). PFNs are neural processes that are trained to approximate the poster…
Mind the Gap: Measuring Generalization Performance Across Multiple Objectives
Matthias Feurer, Katharina Eggensperger, Edward Bergman +3
Modern machine learning models are often constructed taking into account multiple objectives, e.g., minimizing inference time while also maximizing accuracy. Multi-objective hyperp…
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization
Marius Lindauer, Katharina Eggensperger, Matthias Feurer +6
Algorithm parameters, in particular hyperparameters of machine learning algorithms, can substantially impact their performance. To support users in determining well-performing hype…
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO
Katharina Eggensperger, Philipp Müller, Neeratyoy Mallik +6
To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial component of machine learning and its applications. Over the last years, the number of effici…
Squirrel: A Switching Hyperparameter Optimizer
Noor Awad, Gresa Shala, Difan Deng +9
In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach swit…
Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning
Matthias Feurer, Katharina Eggensperger, Stefan Falkner +2
Automated Machine Learning (AutoML) supports practitioners and researchers with the tedious task of designing machine learning pipelines and has recently achieved substantial succe…
OpenML-Python: an extensible Python API for OpenML
Matthias Feurer, Jan N. van Rijn, Arlind Kadra +6
OpenML is an online platform for open science collaboration in machine learning, used to share datasets and results of machine learning experiments. In this paper we introduce Open…
Towards Assessing the Impact of Bayesian Optimization's Own Hyperparameters
Marius Lindauer, Matthias Feurer, Katharina Eggensperger +2
Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well…
BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters
Marius Lindauer, Katharina Eggensperger, Matthias Feurer +4
Hyperparameter optimization and neural architecture search can become prohibitively expensive for regular black-box Bayesian optimization because the training and evaluation of a s…