Adaptive construction of surrogates for the Bayesian solution of inverse problems

Abstract

The Bayesian approach to inverse problems typically relies on posterior sampling approaches, such as Markov chain Monte Carlo, for which the generation of each sample requires one or more evaluations of the parameter-to-observable map or forward model. When these evaluations are computationally intensive, approximations of the forward model are essential to accelerating sample-based inference. Yet the construction of globally accurate approximations for nonlinear forward models can be computationally prohibitive and in fact unnecessary, as the posterior distribution typically concentrates on a small fraction of the support of the prior distribution. We present a new approach that uses stochastic optimization to construct polynomial approximations over a sequence of measures adaptively determined from the data, eventually concentrating on the posterior distribution. The approach yields substantial gains in efficiency and accuracy over prior-based surrogates, as demonstrated via application to inverse problems in partial differential equations.

23 pages, 10 figures

References in corpus (1)

• Sparse Pseudospectral Approximation Method

Cited by in corpus (35)

• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Calibrate, Emulate, Sample
• Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
• Polynomial chaos expansions for dependent random variables
• Accelerating Asymptotically Exact MCMC for Computationally Intensive Models via Local Approximations
• Multi-Output Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Uncertainties
• Surrogate-Based Bayesian Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Approximation Error
• $\mathtt{bajes}$: Bayesian inference of multimessenger astrophysical data, methods and application to gravitational-waves
• Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
• Adaptive Model Refinement Approach for Bayesian Uncertainty Quantification in Turbulence Model
• Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inference
• Adaptive Importance Sampling based Neural Network framework for Reliability and Sensitivity Prediction for Variable Stiffness Composite Laminates with hybrid uncertainties
• An adaptive reduced basis ANOVA method for high-dimensional Bayesian inverse problems
• Bayesian model inversion using stochastic spectral embedding
• A two-stage ensemble Kalman filter based on multiscale model reduction for inverse problems in time fractional diffusion-wave equations
• Bayesian tomography with prior-knowledge-based parametrization and surrogate modeling
• Goal-oriented adaptive surrogate construction for stochastic inversion
• Adaptive sampling-based quadrature rules for efficient Bayesian prediction
• Towards a machine learning pipeline in reduced order modelling for inverse problems: neural networks for boundary parametrization, dimensionality reduction and solution manifold approximation
• An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
• Multilevel adaptive sparse Leja approximations for Bayesian inverse problems
• Deep adaptive sampling for surrogate modeling without labeled data
• Data-Driven Forward Discretizations for Bayesian Inversion
• Development of hp-inverse model by using generalized polynomial chaos
• Novel Deep neural networks for solving Bayesian statistical inverse
• Adaptive Gaussian process surrogates for Bayesian inference
• MCMC-Net: Accelerating Markov Chain Monte Carlo with Neural Networks for Inverse Problems
• A Generalized Probabilistic Learning Approach for Multi-Fidelity Uncertainty Propagation in Complex Physical Simulations
• Bayesian Approach to Inverse Time-harmonic Acoustic Scattering from Sound-soft Obstacles with Phaseless Data
• Adaptive particle-based approximations of the Gibbs posterior for inverse problems
• An adaptive independence sampler MCMC algorithm for infinite dimensional Bayesian inferences
• Calibrating a Finite-strain Phase-field Model of Fracture for Bonded Granular Materials with Uncertainty Quantification
• Adaptive Gaussian process approximation for Bayesian inference with expensive likelihood functions
• Error control in the numerical posterior distribution in the Bayesian UQ analysis of a semilinear evolution PDE
• A hybrid adaptive MCMC algorithm in function spaces