6 papers · 1 filter
Provably Reduced Sample Cost in Prior-Guided Hyperparameter Optimization
Leona Hennig, Jasmin Brandt, Lukas Fehring +3
Large-scale hyperparameter optimization (HPO) in automated machine learning (AutoML) consumes substantial computational resources, raising growing concerns about scalability and en…
Dynamic Hyperparameter Importance for Efficient Multi-Objective Optimization
Daphne Theodorakopoulos, Marcel Wever, Marius Lindauer
Choosing a suitable ML model is a complex task that can depend on several objectives, e.g., accuracy, fairness, or energy consumption. In practice, this requires trading off multip…
Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
Lukas Fehring, Marcel Wever, Maximilian Spliethöver +3
Bayesian optimization (BO) is a widely used approach to hyperparameter optimization (HPO). However, most existing HPO methods only incorporate expert knowledge during initializatio…
State-Space Models for Tabular Prior-Data Fitted Networks
Felix Koch, Marcel Wever, Fabian Raisch +1
Recent advancements in foundation models for tabular data, such as TabPFN, demonstrated that pretrained Transformer architectures can approximate Bayesian inference with high predi…
DeepCAVE: A Visualization and Analysis Tool for Automated Machine Learning
Sarah Segel, Helena Graf, Edward Bergman +5
Hyperparameter optimization (HPO), as a central paradigm of AutoML, is crucial for leveraging the full potential of machine learning (ML) models; yet its complexity poses challenge…
HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimization
Marcel Wever, Maximilian Muschalik, Fabian Fumagalli +1
Hyperparameter optimization (HPO) is a crucial step in achieving strong predictive performance. Yet, the impact of individual hyperparameters on model generalization is highly cont…