Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inference
arXiv:2312.05153 · doi:10.1007/s11222-025-10597-8
Abstract
Surrogate models are statistical or conceptual approximations for more complex simulation models. In this context, it is crucial to propagate the uncertainty induced by limited simulation budget and surrogate approximation error to predictions, inference, and subsequent decision-relevant quantities. However, quantifying and then propagating the uncertainty of surrogates is usually limited to special analytic cases or is otherwise computationally very expensive. In this paper, we propose a framework enabling a scalable, Bayesian approach to surrogate modeling with thorough uncertainty quantification, propagation, and validation. Specifically, we present three methods for Bayesian inference with surrogate models given measurement data. This is a task where the propagation of surrogate uncertainty is especially relevant, because failing to account for it may lead to biased and/or overconfident estimates of the parameters of interest. We showcase our approach in three detailed case studies for linear and nonlinear real-world modeling scenarios. Uncertainty propagation in surrogate models enables more reliable and safe approximation of expensive simulators and will therefore be useful in various fields of applications.
References in corpus (7)
- Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisons
- Detecting and diagnosing prior and likelihood sensitivity with power-scaling
- Simulation-Based Calibration Checking for Bayesian Computation: The Choice of Test Quantities Shapes Sensitivity
- Improved uncertainty quantification for neural networks with Bayesian last layer
- Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
- A fully Bayesian sparse polynomial chaos expansion approach with joint priors on the coefficients and global selection of terms
- Discussion of Big Bayes Stories and BayesBag