A Bit of Information Theory, and the Data Augmentation Algorithm Converges
arXiv:0811.0174 · doi:10.1109/TIT.2008.929918
Abstract
The data augmentation (DA) algorithm is a simple and powerful tool in statistical computing. In this note basic information theory is used to prove a nontrivial convergence theorem for the DA algorithm.