Multi-fidelity Bayesian Optimization with Max-value Entropy Search and its parallelization

Abstract

In a standard setting of Bayesian optimization (BO), the objective function evaluation is assumed to be highly expensive. Multi-fidelity Bayesian optimization (MFBO) accelerates BO by incorporating lower fidelity observations available with a lower sampling cost. In this paper, we focus on the information-based approach, which is a popular and empirically successful approach in BO. For MFBO, however, existing information-based methods are plagued by difficulty in estimating the information gain. We propose an approach based on max-value entropy search (MES), which greatly facilitates computations by considering the entropy of the optimal function value instead of the optimal input point. We show that, in our multi-fidelity MES (MF-MES), most of additional computations, compared with usual MES, is reduced to analytical computations. Although an additional numerical integration is necessary for the information across different fidelities, this is only in one dimensional space, which can be performed efficiently and accurately. Further, we also propose parallelization of MF-MES. Since there exist a variety of different sampling costs, queries typically occur asynchronously in MFBO. We show that similar simple computations can be derived for asynchronous parallel MFBO. We demonstrate effectiveness of our approach by using benchmark datasets and a real-world application to materials science data.

arXiv comment31 pages, 5 figures

References in corpus (11)

• Practical Bayesian Optimization of Machine Learning Algorithms
• Expectation Propagation for approximate Bayesian inference
• Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
• Batch Bayesian Optimization via Local Penalization
• Max-value Entropy Search for Efficient Bayesian Optimization
• Multi-fidelity Bayesian Optimisation with Continuous Approximations
• A General Framework for Multi-fidelity Bayesian Optimization with Gaussian Processes
• Parallel Predictive Entropy Search for Batch Global Optimization of Expensive Objective Functions
• Moments Calculation For the Doubly Truncated Multivariate Normal Density
• Fast Information-theoretic Bayesian Optimisation
• Practical Bayesian Optimization for Variable Cost Objectives

Cited by in corpus (8)

• Multi-Fidelity Bayesian Optimization via Deep Neural Networks
• Information-Theoretic Multi-Objective Bayesian Optimization with Continuous Approximations
• BOSH: Bayesian Optimization by Sampling Hierarchically
• Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks
• Lookahead Acquisition Functions for Finite-Horizon Time-Dependent Bayesian Optimization and Application to Quantum Optimal Control
• Active Learning with Weak Supervision for Gaussian Processes
• Multi-Fidelity Multi-Objective Bayesian Optimization: An Output Space Entropy Search Approach
• Neural fidelity warping for efficient robot morphology design