Multi-Objective Bayesian Optimization over High-Dimensional Search Spaces
arXiv:2109.10964
Abstract
Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of its high sample efficiency. However, even with recent methodological advances, most existing multi-objective BO methods perform poorly on search spaces with more than a few dozen parameters and rely on global surrogate models that scale cubically with the number of observations. In this work we propose MORBO, a scalable method for multi-objective BO over high-dimensional search spaces. MORBO identifies diverse globally optimal solutions by performing BO in multiple local regions of the design space in parallel using a coordinated strategy. We show that MORBO significantly advances the state-of-the-art in sample efficiency for several high-dimensional synthetic problems and real world applications, including an optical display design problem and a vehicle design problem with 146 and 222 parameters, respectively. On these problems, where existing BO algorithms fail to scale and perform well, MORBO provides practitioners with order-of-magnitude improvements in sample efficiency over the current approach.
To appear at UAI 2022. 24 pages
References in corpus (11)
- An Easy-to-use Real-world Multi-objective Optimization Problem Suite
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimization
- Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020
- Scalable Global Optimization via Local Bayesian Optimization
- Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization
- Adaptive and Safe Bayesian Optimization in High Dimensions via One-Dimensional Subspaces
- High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspaces
- Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement
- Fast Matrix Square Roots with Applications to Gaussian Processes and Bayesian Optimization
- Efficient Multi-Objective Optimization through Population-based Parallel Surrogate Search
- Parallel Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints