Sequential design of multi-fidelity computer experiments: maximizing the rate of stepwise uncertainty reduction

Abstract

This article deals with the sequential design of experiments for (deterministic or stochastic) multi-fidelity numerical simulators, that is, simulators that offer control over the accuracy of simulation of the physical phenomenon or system under study. Very often, accurate simulations correspond to high computational efforts whereas coarse simulations can be obtained at a smaller cost. In this setting, simulation results obtained at several levels of fidelity can be combined in order to estimate quantities of interest (the optimal value of the output, the probability that the output exceeds a given threshold...) in an efficient manner. To do so, we propose a new Bayesian sequential strategy called Maximal Rate of Stepwise Uncertainty Reduction (MR-SUR), that selects additional simulations to be performed by maximizing the ratio between the expected reduction of uncertainty and the cost of simulation. This generic strategy unifies several existing methods, and provides a principled approach to develop new ones. We assess its performance on several examples, including a computationally intensive problem of fire safety analysis where the quantity of interest is the probability of exceeding a tenability threshold during a building fire.

arXiv commentTechnometrics, Taylor & Francis

References in corpus (9)

• Practical Bayesian Optimization of Machine Learning Algorithms
• Sequential design of computer experiments for the estimation of a probability of failure
• Practical heteroskedastic Gaussian process modeling for large simulation experiments
• A Bayesian approach to constrained single- and multi-objective optimization
• Adaptive Design of Experiments for Conservative Estimation of Excursion Sets
• A supermartingale approach to Gaussian process based sequential design of experiments
• Gaussian process modeling for stochastic multi-fidelity simulators, with application to fire safety
• Sequential design of experiments to estimate a probability of exceeding a threshold in a multi-fidelity stochastic simulator
• Integrating hyper-parameter uncertainties in a multi-fidelity Bayesian model for the estimation of a probability of failure

Cited by in corpus (2)

• Collaborative and Distributed Bayesian Optimization via Consensus: Showcasing the Power of Collaboration for Optimal Design
• Active Learning with Adaptive Non-Stationary Kernel for Continuous-Fidelity Surrogate Models