A Multi-fidelity Estimator of the Expected Information Gain for Bayesian Optimal Experimental Design

Abstract

Optimal experimental design (OED) is a framework that leverages a mathematical model of the experiment to identify optimal conditions for conducting the experiment. Under a Bayesian approach, the design objective function is typically chosen to be the expected information gain (EIG). However, EIG is intractable for nonlinear models and must be estimated numerically. Estimating the EIG generally entails some variant of Monte Carlo sampling, requiring repeated data model and likelihood evaluations $\unicode{x2013}$ each involving solving the governing equations of the experimental physics $\unicode{x2013}$ under different sample realizations. This computation becomes impractical for high-fidelity models. We introduce a novel multi-fidelity EIG (MF-EIG) estimator under the approximate control variate (ACV) framework. This estimator is unbiased with respect to the high-fidelity mean, and minimizes variance under a given computational budget. We achieve this by first reparameterizing the EIG so that its expectations are independent of the data models, a requirement for compatibility with ACV. We then provide specific examples under different data model forms, as well as practical enhancements of sample size optimization and sample reuse techniques. We demonstrate the MF-EIG estimator in two numerical examples: a nonlinear benchmark and a turbulent flow problem involving the calibration of shear-stress transport turbulence closure model parameters within the Reynolds-averaged Navier-Stokes model. We validate the estimator's unbiasedness and observe one- to two-orders-of-magnitude variance reduction compared to existing single-fidelity EIG estimators.

References in corpus (9)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Simulation-based optimal Bayesian experimental design for nonlinear systems
• A Generalized Approximate Control Variate Framework for Multifidelity Uncertainty Quantification
• Fast Bayesian experimental design: Laplace-based importance sampling for the expected information gain
• Optimal experimental design: Formulations and computations
• Multifidelity uncertainty quantification with models based on dissimilar parameters
• Variational Bayesian experimental design for geophysical applications: seismic source location, amplitude versus offset inversion, and estimating CO2 saturations in a subsurface reservoir
• Multilevel Monte Carlo estimation of expected information gains
• Stability estimates for the expected utility in Bayesian optimal experimental design

Cited by in corpus (1)

• Single and Multi-Objective Optimization of Distributed Acoustic Sensing Cable Layouts for Geophysical Applications