5 papers
mlr3mbo: Bayesian Optimization in R
Marc Becker, Lennart Schneider, Martin Binder +2
We present mlr3mbo, a modular toolbox for Bayesian optimization in R. mlr3mbo supports single- and multi-objective optimization, multi-point proposals, batch and asynchronous paral…
Overtuning in Hyperparameter Optimization
Lennart Schneider, Bernd Bischl, Matthias Feurer
Hyperparameter optimization (HPO) aims to identify an optimal hyperparameter configuration (HPC) such that the resulting model generalizes well to unseen data. As the expected gene…
Hyperband-based Bayesian Optimization for Black-box Prompt Selection
Lennart Schneider, Martin Wistuba, Aaron Klein +3
Optimal prompt selection is crucial for maximizing large language model (LLM) performance on downstream tasks, especially in black-box settings where models are only accessible via…
Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization
Thomas Nagler, Lennart Schneider, Bernd Bischl +1
Hyperparameter optimization is crucial for obtaining peak performance of machine learning models. The standard protocol evaluates various hyperparameter configurations using a resa…
Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview
Florian Karl, Tobias Pielok, Julia Moosbauer +10
Hyperparameter optimization constitutes a large part of typical modern machine learning workflows. This arises from the fact that machine learning methods and corresponding preproc…