6 papers
TACTICL: Task-Aware Compression of Tabular ICL Models
Mykhailo Koshil, Matthias Feurer, Katharina Eggensperger
The strong performance of foundation models for tabular tasks comes at substantial inference costs. Distilling models into task-specific architectures reduces model size and comput…
ShaplEIG: Bayesian Experimental Design for Shapley Value Estimation
David Rundel, Fabian Fumagalli, Maximilian Muschalik +2
Shapley values are a principled attribution measure widely used in interpretable machine learning, but their exact computation scales exponentially with the number of players, moti…
CASHomon Sets: Efficient Rashomon Sets Across Multiple Model Classes and their Hyperparameters
Fiona Katharina Ewald, Martin Binder, Matthias Feurer +2
Rashomon sets are model sets within one model class that perform nearly as well as a reference model from the same model class. They reveal the existence of alternative well-perfor…
Best Practices For Empirical Meta-Algorithmic Research: Guidelines from the COSEAL Research Network
Theresa Eimer, Lennart Schäpermeier, André Biedenkapp +15
Empirical research on meta-algorithmics, such as algorithm selection, configuration, and scheduling, often relies on extensive and thus computationally expensive experiments. With…
carps: A Framework for Comparing N Hyperparameter Optimizers on M Benchmarks
Carolin Benjamins, Helena Graf, Sarah Segel +14
Hyperparameter Optimization (HPO) is crucial to develop well-performing machine learning models. In order to ease prototyping and benchmarking of HPO methods, we propose carps, a b…
Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization
Thomas Nagler, Lennart Schneider, Bernd Bischl +1
Hyperparameter optimization is crucial for obtaining peak performance of machine learning models. The standard protocol evaluates various hyperparameter configurations using a resa…