Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction

Abstract

Two major bottlenecks to the solution of large-scale Bayesian inverse problems are the scaling of posterior sampling algorithms to high-dimensional parameter spaces and the computational cost of forward model evaluations. Yet incomplete or noisy data, the state variation and parameter dependence of the forward model, and correlations in the prior collectively provide useful structure that can be exploited for dimension reduction in this setting--both in the parameter space of the inverse problem and in the state space of the forward model. To this end, we show how to jointly construct low-dimensional subspaces of the parameter space and the state space in order to accelerate the Bayesian solution of the inverse problem. As a byproduct of state dimension reduction, we also show how to identify low-dimensional subspaces of the data in problems with high-dimensional observations. These subspaces enable approximation of the posterior as a product of two factors: (i) a projection of the posterior onto a low-dimensional parameter subspace, wherein the original likelihood is replaced by an approximation involving a reduced model; and (ii) the marginal prior distribution on the high-dimensional complement of the parameter subspace. We present and compare several strategies for constructing these subspaces using only a limited number of forward and adjoint model simulations. The resulting posterior approximations can rapidly be characterized using standard sampling techniques, e.g., Markov chain Monte Carlo. Two numerical examples demonstrate the accuracy and efficiency of our approach: inversion of an integral equation in atmospheric remote sensing, where the data dimension is very high; and the inference of a heterogeneous transmissivity field in a groundwater system, which involves a partial differential equation forward model with high dimensional state and parameters.

35 pages, 12 figures

References in corpus (3)

• Dimension-independent likelihood-informed MCMC
• Likelihood-informed dimension reduction for nonlinear inverse problems
• Data-Driven Model Reduction for the Bayesian Solution of Inverse Problems

Cited by in corpus (24)

• Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
• Demonstration of the Relationship between Sensitivity and Identifiability for Inverse Uncertainty Quantification
• Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities
• Deep composition of tensor-trains using squared inverse Rosenblatt transports
• Quantification of Uncertainties in Turbulence Modeling: A Comparison of Physics-Based and Random Matrix Theoretic Approaches
• Variational Bayesian Approximation of Inverse Problems using Sparse Precision Matrices
• Multifidelity Approximate Bayesian Computation
• Stochastic Learning Approach to Binary Optimization for Optimal Design of Experiments
• Parameter Estimation with Maximal Updated Densities
• Prior normalization for certified likelihood-informed subspace detection of Bayesian inverse problems
• Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance
• Deep adaptive sampling for surrogate modeling without labeled data
• Learning to solve Bayesian inverse problems: An amortized variational inference approach using Gaussian and Flow guides
• MCMC-Net: Accelerating Markov Chain Monte Carlo with Neural Networks for Inverse Problems
• Scalable optimization-based sampling on function space
• Analysis of sloppiness in model simulations: unveiling parameter uncertainty when mathematical models are fitted to data
• Stein variational reduced basis Bayesian inversion
• Reconstructing the Magnetic Field in an Arbitrary Domain via Data-driven Bayesian Methods and Numerical Simulations
• MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
• Hessian-based sampling for high-dimensional model reduction
• Iterative importance sampling algorithms for parameter estimation
• Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics
• hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty
• Localization for MCMC: sampling high-dimensional posterior distributions with local structure