Gaussian Approximations for Probability Measures on
arXiv:1611.08642
Abstract
This paper concerns the approximation of probability measures on with respect to the Kullback-Leibler divergence. Given an admissible target measure, we show the existence of the best approximation, with respect to this divergence, from certain sets of Gaussian measures and Gaussian mixtures. The asymptotic behavior of such best approximations is then studied in the small parameter limit where the measure concentrates; this asymptotic behaviour is characterized using -convergence. The theory developed is then applied to understanding the frequentist consistency of Bayesian inverse problems. For a fixed realization of noise, we show the asymptotic normality of the posterior measure in the small noise limit. Taking into account the randomness of the noise, we prove a Bernstein-Von Mises type result for the posterior measure.
arXiv comment30 pages
References in corpus (6)
- Bayesian inverse problems with Gaussian priors
- On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
- Poincaré and logarithmic Sobolev inequalities by decomposition of the energy landscape
- Posterior Consistency for Bayesian Inverse Problems through Stability and Regression Results
- Information-theoretic tools for parametrized coarse-graining of non-equilibrium extended systems
- On the Bernstein-Von Mises Theorem for High Dimensional Nonlinear Bayesian Inverse Problems