Approximation Properties of Variational Bayes for Vector Autoregressions
arXiv:1903.00617
Abstract
Variational Bayes (VB) is a recent approximate method for Bayesian inference. It has the merit of being a fast and scalable alternative to Markov Chain Monte Carlo (MCMC) but its approximation error is often unknown. In this paper, we derive the approximation error of VB in terms of mean, mode, variance, predictive density and KL divergence for the linear Gaussian multi-equation regression. Our results indicate that VB approximates the posterior mean perfectly. Factors affecting the magnitude of underestimation in posterior variance and mode are revealed. Importantly, We demonstrate that VB estimates predictive densities accurately.
References in corpus (6)
- Asymptotic normality of maximum likelihood and its variational approximation for stochastic blockmodels
- Frequentist Consistency of Variational Bayes
- Covariances, Robustness, and Variational Bayes
- Asymptotic normality and valid inference for Gaussian variational approximation
- On Statistical Optimality of Variational Bayes
- Fast Inference for Intractable Likelihood Problems using Variational Bayes