Default Machine Learning Hyperparameters Do Not Provide Informative Initialization for Bayesian Optimization

Nicolás Villagrán Prieto, Eduardo C. Garrido-Merchán

Bayesian Optimization (BO) is a standard tool for hyperparameter tuning thanks to its sample efficiency on expensive black-box functions. While most BO pipelines begin with uniform…