A practical tutorial on Variational Bayes
arXiv:2103.01327
Abstract
This tutorial gives a quick introduction to Variational Bayes (VB), also called Variational Inference or Variational Approximation, from a practical point of view. The paper covers a range of commonly used VB methods and an attempt is made to keep the materials accessible to the wide community of data analysis practitioners. The aim is that the reader can quickly derive and implement their first VB algorithm for Bayesian inference with their data analysis problem. An end-user software package in Matlab together with the documentation can be found at https://vbayeslab.github.io/VBLabDocs/
43 pages, 9 figures, 3 tables
References in corpus (6)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- ADADELTA: An Adaptive Learning Rate Method
- New insights and perspectives on the natural gradient method
- Variational Bayesian Inference with Stochastic Search
- Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations