Non-centered parametric variational Bayes' approach for hierarchical inverse problems of partial differential equations

Abstract

This paper proposes a non-centered parameterization based infinite-dimensional mean-field variational inference (NCP-iMFVI) approach for solving the hierarchical Bayesian inverse problems. This method can generate available estimates from the approximated posterior distribution efficiently. To avoid the mutually singular obstacle that occurred in the infinite-dimensional hierarchical approach, we propose a rigorous theory of the non-centered variational Bayesian approach. Since the non-centered parameterization weakens the connection between the parameter and the hyper-parameter, we can introduce the hyper-parameter to all terms of the eigendecomposition of the prior covariance operator. We also show the relationships between the NCP-iMFVI and infinite-dimensional hierarchical approaches with centered parameterization. The proposed algorithm is applied to three inverse problems governed by the simple smooth equation, the Helmholtz equation, and the steady-state Darcy flow equation. Numerical results confirm our theoretical findings, illustrate the efficiency of solving the iMFVI problem formulated by large-scale linear and nonlinear statistical inverse problems, and verify the mesh-independent property.

arXiv comment43 pages

References in corpus (16)

• Variational Inference: A Review for Statisticians
• A General Framework for the Parametrization of Hierarchical Models
• Frequentist Consistency of Variational Bayes
• MAP Estimators and Their Consistency in Bayesian Nonparametric Inverse Problems
• Geometric MCMC for Infinite-Dimensional Inverse Problems
• Posterior Contraction Rates for the Bayesian Approach to Linear Ill-Posed Inverse Problems
• Iterative Updating of Model Error for Bayesian Inversion
• Kullback-Leibler Approximation for Probability Measures on Infinite Dimensional Spaces
• A computational framework for infinite-dimensional Bayesian inverse problems. Part I: The linearized case, with application to global seismic inversion
• A variational Bayesian method for inverse problems with impulsive noise
• Variational Bayes' method for functions with applications to some inverse problems
• hIPPYlib: An Extensible Software Framework for Large-Scale Inverse Problems Governed by PDEs; Part I: Deterministic Inversion and Linearized Bayesian Inference
• Convergence Rates of Variational Posterior Distributions
• Stein variational gradient descent on infinite-dimensional space and applications to statistical inverse problems
• Recursive linearization method for inverse medium scattering problems with complex mixture Gaussian error learning
• Stein variational reduced basis Bayesian inversion