Hybrid Batch Bayesian Optimization

Abstract

Bayesian Optimization aims at optimizing an unknown non-convex/concave function that is costly to evaluate. We are interested in application scenarios where concurrent function evaluations are possible. Under such a setting, BO could choose to either sequentially evaluate the function, one input at a time and wait for the output of the function before making the next selection, or evaluate the function at a batch of multiple inputs at once. These two different settings are commonly referred to as the sequential and batch settings of Bayesian Optimization. In general, the sequential setting leads to better optimization performance as each function evaluation is selected with more information, whereas the batch setting has an advantage in terms of the total experimental time (the number of iterations). In this work, our goal is to combine the strength of both settings. Specifically, we systematically analyze Bayesian optimization using Gaussian process as the posterior estimator and provide a hybrid algorithm that, based on the current state, dynamically switches between a sequential policy and a batch policy with variable batch sizes. We provide theoretical justification for our algorithm and present experimental results on eight benchmark BO problems. The results show that our method achieves substantial speedup (up to %78) compared to a pure sequential policy, without suffering any significant performance loss.

References in corpus (1)

• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning

Cited by in corpus (14)

• Parallelizing Exploration-Exploitation Tradeoffs with Gaussian Process Bandit Optimization
• GLASSES: Relieving The Myopia Of Bayesian Optimisation
• Robust Maximization of Non-Submodular Objectives
• Heteroscedastic Treed Bayesian Optimisation
• Differentially Private Bayesian Optimization
• Bayesian Optimization in a Billion Dimensions via Random Embeddings
• Plasma Spray Process Parameters Configuration using Sample-efficient Batch Bayesian Optimization
• A Domain-Shrinking based Bayesian Optimization Algorithm with Order-Optimal Regret Performance
• Budgeted Batch Bayesian Optimization With Unknown Batch Sizes
• Pareto-efficient Acquisition Functions for Cost-Aware Bayesian Optimization
• Surrogate-based Optimization using Mutual Information for Computer Experiments (optim-MICE)
• Attentive Neural Processes and Batch Bayesian Optimization for Scalable Calibration of Physics-Informed Digital Twins
• Computationally efficient surrogate-based optimization of coastal storm waves heights and run-ups
• Active Offline Policy Selection