Adaptive Design of Experiments for Conservative Estimation of Excursion Sets

Abstract

We consider the problem of estimating the set of all inputs that leads a system to some particular behavior. The system is modeled by an expensive-to-evaluate function, such as a computer experiment, and we are interested in its excursion set, i.e. the set of points where the function takes values above or below some prescribed threshold. The objective function is emulated with a Gaussian Process (GP) model based on an initial design of experiments enriched with evaluation results at (batch-)sequentially determined input points. The GP model provides conservative estimates for the excursion set, which control false positives while minimizing false negatives. We introduce adaptive strategies that sequentially select new evaluations of the function by reducing the uncertainty on conservative estimates. Following the Stepwise Uncertainty Reduction approach we obtain new evaluations by minimizing adapted criteria. Tractable formulae for the conservative criteria are derived, which allow more convenient optimization. The method is benchmarked on random functions generated under the model assumptions in different scenarios of noise and batch size. We then apply it to a reliability engineering test case. Overall, the proposed strategy of minimizing false negatives in conservative estimation achieves competitive performance both in terms of model-based and model-free indicators.

References in corpus (6)

• Sequential design of computer experiments for the estimation of a probability of failure
• Practical heteroskedastic Gaussian process modeling for large simulation experiments
• Bayesian subset simulation
• Spatio-temporal exceedance locations and confidence regions
• Quantifying uncertainties on excursion sets under a Gaussian random field prior
• Estimating orthant probabilities of high dimensional Gaussian vectors with an application to set estimation

Cited by in corpus (4)

• Forecast Evaluation of Quantiles, Prediction Intervals, and other Set-Valued Functionals
• Sequential design of multi-fidelity computer experiments: maximizing the rate of stepwise uncertainty reduction
• A Finite-Horizon Approach to Active Level Set Estimation
• Bayesian sequential design of computer experiments for quantile set inversion