Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints

Abstract

This work presents PESMOC, Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints, an information-based strategy for the simultaneous optimization of multiple expensive-to-evaluate black-box functions under the presence of several constraints. PESMOC can hence be used to solve a wide range of optimization problems. Iteratively, PESMOC chooses an input location on which to evaluate the objective functions and the constraints so as to maximally reduce the entropy of the Pareto set of the corresponding optimization problem. The constraints considered in PESMOC are assumed to have similar properties to those of the objective functions in typical Bayesian optimization problems. That is, they do not have a known expression (which prevents gradient computation), their evaluation is considered to be very expensive, and the resulting observations may be corrupted by noise. These constraints arise in a plethora of expensive black-box optimization problems. We carry out synthetic experiments to illustrate the effectiveness of PESMOC, where we sample both the objectives and the constraints from a Gaussian process prior. The results obtained show that PESMOC is able to provide better recommendations with a smaller number of evaluations than a strategy based on random search.

6 pages 2 figures

References in corpus (9)

• Practical Bayesian Optimization of Machine Learning Algorithms
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Expectation Propagation for approximate Bayesian inference
• Scalable Bayesian Optimization Using Deep Neural Networks
• Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
• Bayesian Optimization with Unknown Constraints
• mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions
• Slice sampling covariance hyperparameters of latent Gaussian models
• Predictive Entropy Search for Bayesian Optimization with Unknown Constraints

Cited by in corpus (16)

• Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processes
• Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes
• Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization
• OpenBox: A Generalized Black-box Optimization Service
• Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement
• A Flexible Framework for Multi-Objective Bayesian Optimization using Random Scalarizations
• Suggesting Cooking Recipes Through Simulation and Bayesian Optimization
• Advanced Manufacturing Configuration by Sample-efficient Batch Bayesian Optimization
• Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization
• Max-value Entropy Search for Multi-Objective Bayesian Optimization with Constraints
• Uncertainty aware Search Framework for Multi-Objective Bayesian Optimization with Constraints
• Parallel Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
• Cost-aware Multi-objective Bayesian optimisation
• Towards Automatic Bayesian Optimization: A first step involving acquisition functions
• Uncertainty Weighted Causal Graphs
• A Similarity Measure of Gaussian Process Predictive Distributions