Variational Bayes: A report on approaches and applications
arXiv:1905.10744
Abstract
Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model uncertainty. Variational methods have been used for approximating intractable integrals that arise in Bayesian inference for neural networks. In this report, we review the major variational inference concepts pertinent to Bayesian neural networks and compare various approximation methods used in literature. We also talk about the applications of variational bayes in Reinforcement learning and continual learning.
References in corpus (9)
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Weight Uncertainty in Neural Networks
- Density estimation using Real NVP
- Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference
- Noisy Networks for Exploration
- Variational Continual Learning
- Multiplicative Normalizing Flows for Variational Bayesian Neural Networks
- Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriors
- UCB Exploration via Q-Ensembles