Sampling Methods for Bayesian Inference Involving Convergent Noisy Approximations of Forward Maps

Abstract

We present Bayesian techniques for solving inverse problems which involve mean-square convergent random approximations of the forward map. Noisy approximations of the forward map arise in several fields, such as multiscale problems and probabilistic numerical methods. In these fields, a random approximation can enhance the quality or the efficiency of the inference procedure, but entails additional theoretical and computational difficulties due to the randomness of the forward map. A standard technique to address this issue is to combine Monte Carlo averaging with Markov chain Monte Carlo samplers, as for example in the pseudo-marginal Metropolis--Hastings methods. In this paper, we consider mean-square convergent random approximations, and quantify how Monte Carlo errors propagate from the forward map to the solution of the inverse problems. Moreover, we review and describe simple techniques to solve such inverse problems, and compare performances with a series of numerical experiments.

References in corpus (16)

• The pseudo-marginal approach for efficient Monte Carlo computations
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Inferring solutions of differential equations using noisy multi-fidelity data
• The statistical finite element method (statFEM) for coherent synthesis of observation data and model predictions
• Gamblets for opening the complexity-bottleneck of implicit schemes for hyperbolic and parabolic ODEs/PDEs with rough coefficients
• Probabilistic Numerical Methods for PDE-constrained Bayesian Inverse Problems
• Probabilistic ODE Solvers with Runge-Kutta Means
• Well-posed Bayesian inverse problems and heavy-tailed stable quasi-Banach space priors
• Perturbation Bounds for Monte Carlo within Metropolis via Restricted Approximations
• Strong convergence rates of probabilistic integrators for ordinary differential equations
• A probabilistic finite element method based on random meshes: Error estimators and Bayesian inverse problems
• Implicit Probabilistic Integrators for ODEs
• Probabilistic Linear Multistep Methods
• Generalized Parallel Tempering on Bayesian Inverse Problems
• Randomised one-step time integration methods for deterministic operator differential equations
• A Data-Scalable Randomized Misfit Approach for Solving Large-Scale PDE-Constrained Inverse Problems