A Generalized Approximate Control Variate Framework for Multifidelity Uncertainty Quantification

Abstract

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost models --- which are typically lower fidelity with unknown statistics --- are used to reduce the variance in statistical estimators relative to a MC estimator with equivalent cost. We derive the conditions under which our proposed approximate control variate framework recovers existing multi-model variance reduction schemes as special cases. We demonstrate that these existing strategies use recursive sampling strategies, and as a result, their maximum possible variance reduction is limited to that of a control variate algorithm that uses only a single low-fidelity model with known mean. This theoretical result holds regardless of the number of low-fidelity models and/or samples used to build the estimator. We then derive new sampling strategies within our framework that circumvent this limitation to make efficient use of all available information sources. In particular, we demonstrate that a significant gap can exist, of orders of magnitude in some cases, between the variance reduction achievable by using a single low-fidelity model and our non-recursive approach. We also present initial sample allocation approaches for exploiting this gap. They yield the greatest benefit when augmenting the high-fidelity model evaluations is impractical because, for instance, they arise from a legacy database. Several analytic examples and an example with a hyperbolic PDE describing elastic wave propagation in heterogeneous media are used to illustrate the main features of the methodology.

References in corpus (3)

• A Low-rank Control Variate for Multilevel Monte Carlo Simulation of High-dimensional Uncertain Systems
• Survey of multifidelity methods in uncertainty propagation, inference, and optimization
• Optimal fidelity multi-level Monte Carlo for quantification of uncertainty in simulations of cloud cavitation collapse

Cited by in corpus (18)

• Multilevel and multifidelity uncertainty quantification for cardiovascular hemodynamics
• CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations
• Active Learning with Multifidelity Modeling for Efficient Rare Event Simulation
• Multifidelity uncertainty quantification with models based on dissimilar parameters
• Bi-fidelity Variational Auto-encoder for Uncertainty Quantification
• Multi-output multilevel best linear unbiased estimators via semidefinite programming
• Modern Monte Carlo Methods for Efficient Uncertainty Quantification and Propagation: A Survey
• Uncertainty Quantification of Ship Resistance via Multi-Index Stochastic Collocation and Radial Basis Function Surrogates: A Comparison
• Hyper-differential sensitivity analysis with respect to model discrepancy: Optimal solution updating
• Multivariate extensions of the Multilevel Best Linear Unbiased Estimator for ensemble-variational data assimilation
• Optimized parametric inference for the inner loop of the Multigrid Ensemble Kalman Filter
• Multi-fidelity uncertainty quantification for homogenization problems in structure-property relationships from crystal plasticity finite elements
• A Multi-fidelity Estimator of the Expected Information Gain for Bayesian Optimal Experimental Design
• Budget-limited distribution learning in multifidelity problems
• Noise-robust multi-fidelity surrogate modelling for parametric partial differential equations
• Multilevel Surrogate-based Control Variates
• On the performance of multi-fidelity and reduced-dimensional neural emulators for inference of physiological boundary conditions
• A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems