MAP Estimators and Their Consistency in Bayesian Nonparametric Inverse Problems

Abstract

We consider the inverse problem of estimating an unknown function $u$ from noisy measurements $y$ of a known, possibly nonlinear, map $\mathcal{G}$ applied to $u$. We adopt a Bayesian approach to the problem and work in a setting where the prior measure is specified as a Gaussian random field ${\mu }_0$. We work under a natural set of conditions on the likelihood which imply the existence of a well-posed posterior measure, ${\mu }^y$. Under these conditions we show that the {\em maximum a posteriori} (MAP) estimator is well-defined as the minimiser of an Onsager-Machlup functional defined on the Cameron-Martin space of the prior; thus we link a problem in probability with a problem in the calculus of variations. We then consider the case where the observational noise vanishes and establish a form of Bayesian posterior consistency. We also prove a similar result for the case where the observation of $\mathcal{G}(u)$ can be repeated as many times as desired with independent identically distributed noise. The theory is illustrated with examples from an inverse problem for the Navier-Stokes equation, motivated by problems arising in weather forecasting, and from the theory of conditioned diffusions, motivated by problems arising in molecular dynamics.

changed title, minor fixes

References in corpus (3)

• Posterior Contraction Rates for the Bayesian Approach to Linear Ill-Posed Inverse Problems
• Consistency of the posterior distribution in generalised linear inverse problems
• Least-action filtering

Cited by in corpus (56)

• Data Assimilation: A Mathematical Introduction
• Dimension-independent likelihood-informed MCMC
• Proposals which speed-up function-space MCMC
• Maximum-A-Posteriori Estimates in Linear Inverse Problems with Log-concave Priors are Proper Bayes Estimators
• Posterior Consistency for Bayesian Inverse Problems through Stability and Regression Results
• Kullback-Leibler Approximation for Probability Measures on Infinite Dimensional Spaces
• Sparsity-promoting and edge-preserving maximum a posteriori estimators in non-parametric Bayesian inverse problems
• Hessian-based adaptive sparse quadrature for infinite-dimensional Bayesian inverse problems
• Nonparametric statistical inference for drift vector fields of multi-dimensional diffusions
• A TV-Gaussian prior for infinite-dimensional Bayesian inverse problems and its numerical implementations
• Convergence Rates for Learning Linear Operators from Noisy Data
• Solving and Learning Nonlinear PDEs with Gaussian Processes
• Estimation of the Robin coefficient field in a Poisson problem with uncertain conductivity field
• Posterior consistency and convergence rates for Bayesian inversion with hypoelliptic operators
• Generalized modes in Bayesian inverse problems
• Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification
• Nonparametric Bayesian inference for reversible multi-dimensional diffusions
• Γ-convergence of Onsager-Machlup functionals. Part I: With applications to maximum a posteriori estimation in Bayesian inverse problems
• MAP Estimators for Piecewise Continuous Inversion
• Variational Bayes' method for functions with applications to some inverse problems
• Bayesian approach to inverse problems for functions with variable index Besov prior
• A McKean optimal transportation perspective on Feynman-Kac formulae with application to data assimilation
• Γ-convergence of Onsager-Machlup functionals. Part II: Infinite product measures on Banach spaces
• Equivalence of weak and strong modes of measures on topological vector spaces
• Maximum a posteriori estimators in ${\ell }^p$ are well-defined for diagonal Gaussian priors
• Infinite-dimensional Bayesian approach for inverse scattering problems of a fractional Helmholtz equation
• An order-theoretic perspective on modes and maximum a posteriori estimation in Bayesian inverse problems
• A path-integral approach to Bayesian inference for inverse problems using the semiclassical approximation
• Recursive linearization method for inverse medium scattering problems with complex mixture Gaussian error learning
• Multiplicative noise in Bayesian inverse problems: Well-posedness and consistency of MAP estimators
• Bayesian inverse problems with unknown operators
• Filtering Dynamical Systems Using Observations of Statistics
• Posterior Consistency of Semi-Supervised Regression on Graphs
• Convergence rates for Penalised Least Squares Estimators in PDE-constrained regression problems
• Maximum a posteriori probability estimates in infinite-dimensional Bayesian inverse problems
• A regularization method for the parameter estimation problem in ordinary differential equations via discrete optimal control theory
• Non-centered parametric variational Bayes' approach for hierarchical inverse problems of partial differential equations
• Frequentist Consistency of Generalized Variational Inference
• Bregman Cost for Non-Gaussian Noise
• An adaptive independence sampler MCMC algorithm for infinite dimensional Bayesian inferences
• A note on the Karhunen-Loève expansions for infinite-dimensional Bayesian inverse problems
• Are minimizers of the Onsager-Machlup functional strong posterior modes?
• Elements of asymptotic theory with outer probability measures
• A randomized maximum a posterior method for posterior sampling of high dimensional nonlinear Bayesian inverse problems
• Gaussian approximations for transition paths in Brownian dynamics
• NLTG Priors in Medical Image: Nonlocal TV-Gaussian (NLTG) prior for Bayesian inverse problems with applications to Limited CT Reconstruction
• Strong maximum a posteriori estimation in Banach spaces with Gaussian priors
• Covariance models and Gaussian process regression for the wave equation. Application to related inverse problems
• A Feynman-Kac Type Theorem for ODEs: Solutions of Second Order ODEs as Modes of Diffusions
• A Hadamard fractioal total variation-Gaussian (HFTG) prior for Bayesian inverse problems
• MAP estimators for nonparametric Bayesian inverse problems in Banach spaces
• Stochastic Galerkin finite element method with local conductivity basis for electrical impedance tomography
• An adaptive augmented regularization method and its applications
• Optimization Based Methods for Partially Observed Chaotic Systems
• Hierarchical surrogate-based Approximate Bayesian Computation for an electric motor test bench
• A general fractional total variation-Gaussian (GFTG) prior for Bayesian inverse problems