Iterative Updating of Model Error for Bayesian Inversion

Abstract

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when optimization algorithms are used to find a single estimate, or to speed up Markov chain Monte Carlo (MCMC) calculations in the Bayesian framework. The use of an approximate model introduces a discrepancy, or modeling error, that may have a detrimental effect on the solution of the ill-posed inverse problem, or it may severely distort the estimate of the posterior distribution. In the Bayesian paradigm, the modeling error can be considered as a random variable, and by using an estimate of the probability distribution of the unknown, one may estimate the probability distribution of the modeling error and incorporate it into the inversion. We introduce an algorithm which iterates this idea to update the distribution of the model error, leading to a sequence of posterior distributions that are demonstrated empirically to capture the underlying truth with increasing accuracy. Since the algorithm is not based on rejections, it requires only limited full model evaluations. We show analytically that, in the linear Gaussian case, the algorithm converges geometrically fast with respect to the number of iterations. For more general models, we introduce particle approximations of the iteratively generated sequence of distributions; we also prove that each element of the sequence converges in the large particle limit. We show numerically that, as in the linear case, rapid convergence occurs with respect to the number of iterations. Additionally, we show through computed examples that point estimates obtained from this iterative algorithm are superior to those obtained by neglecting the model error.

39 pages, 9 figures

Cited by in corpus (14)

• Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems
• Reduced and All-at-Once Approaches for Model Calibration and Discovery in Computational Solid Mechanics
• Estimation of the Robin coefficient field in a Poisson problem with uncertain conductivity field
• A probabilistic finite element method based on random meshes: Error estimators and Bayesian inverse problems
• Gaussian processes for Bayesian inverse problems associated with linear partial differential equations
• CUQIpy: II. Computational uncertainty quantification for PDE-based inverse problems in Python
• Infinite-dimensional Bayesian approach for inverse scattering problems of a fractional Helmholtz equation
• Ensemble Kalman filter for multiscale inverse problems
• Recursive linearization method for inverse medium scattering problems with complex mixture Gaussian error learning
• A Sketched Finite Element Method for Elliptic Models
• Non-centered parametric variational Bayes' approach for hierarchical inverse problems of partial differential equations
• Choosing observation operators to mitigate model error in Bayesian inverse problems
• Statistical reduced order modelling for the parametric Helmholtz equation
• On the performance of multi-fidelity and reduced-dimensional neural emulators for inference of physiological boundary conditions