Bayesian Update with Importance Sampling: Required Sample Size

Abstract

Importance sampling is used to approximate Bayes' rule in many computational approaches to Bayesian inverse problems, data assimilation and machine learning. This paper reviews and further investigates the required sample size for importance sampling in terms of the ${\chi }^2$-divergence between target and proposal. We develop general abstract theory and illustrate through numerous examples the roles that dimension, noise-level and other model parameters play in approximating the Bayesian update with importance sampling. Our examples also facilitate a new direct comparison of standard and optimal proposals for particle filtering.

References in corpus (7)

• Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems
• Can local particle filters beat the curse of dimensionality?
• Sharp failure rates for the bootstrap particle filter in high dimensions
• On the Chi square and higher-order Chi distances for approximating f-divergences
• Conditions for successful data assimilation
• Adaptive Importance Sampling via Stochastic Convex Programming
• Inverse Problems and Data Assimilation

Cited by in corpus (1)

• Non-Asymptotic Analysis of Ensemble Kalman Updates: Effective Dimension and Localization