Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems

Abstract

The polynomial chaos (PC) expansion has been widely used as a surrogate model in the Bayesian inference to speed up the Markov chain Monte Carlo (MCMC) calculations. However, the use of a PC surrogate introduces the modeling error, that may severely distort the estimate of the posterior distribution. This error can be corrected by increasing the order of the PC expansion, but the cost for building the surrogate may increase dramatically. In this work, we seek to address this challenge by proposing an adaptive procedure to construct a multi-fidelity PC surrogate. This new strategy combines (a large number of) low-fidelity surrogate model evaluations and (a small number of) high-fidelity model evaluations, yielding an adaptive multi-fidelity approach. Here the low-fidelity surrogate is chosen as the prior-based PC surrogate, while the high-fidelity model refers to the true forward model. The key idea is to construct and refine the multi-fidelity approach over a sequence of samples adaptively determined form data, so that the approximation can eventually concentrate to the posterior distribution. We illustrate the performance of the proposed strategy through two nonlinear inverse problems. It is shown that the proposed adaptive multi-fidelity approach can improve significantly the accuracy, yet without a dramatic increase in the computational complexity. The numerical results also indicate that our new algorithm can enhance the efficiency by several orders of magnitude compared to a standard MCMC approach using only the true forward model.

25 pages

Cited by in corpus (36)

• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• fPINNs: Fractional Physics-Informed Neural Networks
• Transfer learning based multi-fidelity physics informed deep neural network
• Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial
• Calibrate, Emulate, Sample
• A support vector regression-based multi-fidelity surrogate model
• Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
• Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems
• Multi-Output Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Uncertainties
• Surrogate-Based Bayesian Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Approximation Error
• Demonstration of the Relationship between Sensitivity and Identifiability for Inverse Uncertainty Quantification
• A non-intrusive reduced-order modeling method using polynomial chaos expansion
• Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
• Image Inversion and Uncertainty Quantification for Constitutive Laws of Pattern Formation
• An adaptive reduced basis ANOVA method for high-dimensional Bayesian inverse problems
• Multi-fidelity Bayesian Optimization: A Review
• Bayesian model inversion using stochastic spectral embedding
• Bi-fidelity Variational Auto-encoder for Uncertainty Quantification
• Stein variational gradient descent with local approximations
• A bi-fidelity method for the multiscale Boltzmann equation with random parameters
• Multilevel adaptive sparse Leja approximations for Bayesian inverse problems
• An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
• Bayesian model calibration with interpolating polynomials based on adaptively weighted Leja nodes
• Goal-Oriented A-Posteriori Estimation of Model Error as an Aid to Parameter Estimation
• Auto-weighted Bayesian Physics-Informed Neural Networks and robust estimations for multitask inverse problems in pore-scale imaging of dissolution
• Bayesian Approach to Inverse Time-harmonic Acoustic Scattering from Sound-soft Obstacles with Phaseless Data
• Probabilistic Constrained Bayesion Inversion for Transpiration Cooling
• An adaptive multi-fidelity PC-based ensemble Kalman inversion for inverse problems
• Reconstructing the Magnetic Field in an Arbitrary Domain via Data-driven Bayesian Methods and Numerical Simulations
• Error control in the numerical posterior distribution in the Bayesian UQ analysis of a semilinear evolution PDE
• Inverse scattering by a random periodic structure
• An artificial neural network approximation for Cauchy inverse problems
• Bayesian identification of discontinuous fields with an ensemble-based variable separation multiscale method
• Parameter identification in uncertain scalar conservation laws discretized with the discontinuous stochastic Galerkin Scheme
• A non-intrusive reduced basis EKI for time-fractional diffusion inverse problems
• An acceleration strategy for randomize-then-optimize sampling via deep neural networks