Asymptotically exact data augmentation: models, properties and algorithms

Abstract

Data augmentation, by the introduction of auxiliary variables, has become an ubiquitous technique to improve convergence properties, simplify the implementation or reduce the computational time of inference methods such as Markov chain Monte Carlo ones. Nonetheless, introducing appropriate auxiliary variables while preserving the initial target probability distribution and offering a computationally efficient inference cannot be conducted in a systematic way. To deal with such issues, this paper studies a unified framework, coined asymptotically exact data augmentation (AXDA), which encompasses both well-established and more recent approximate augmented models. In a broader perspective, this paper shows that AXDA models can benefit from interesting statistical properties and yield efficient inference algorithms. In non-asymptotic settings, the quality of the proposed approximation is assessed with several theoretical results. The latter are illustrated on standard statistical problems. Supplementary materials including computer code for this paper are available online.

arXiv comment63 pages

References in corpus (5)

• Approximate Bayesian computation (ABC) gives exact results under the assumption of model error
• Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency
• Split-and-augmented Gibbs sampler - Application to large-scale inference problems
• From EM to Data Augmentation: The Emergence of MCMC Bayesian Computation in the 1980s
• Unsupervised bayesian convex deconvolution based on a field with an explicit partition function

Cited by in corpus (4)

• High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm
• Fast Scalable Image Restoration using Total Variation Priors and Expectation Propagation
• A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems
• Uncertainty Quantification in CT pulmonary angiography