Kernel Implicit Variational Inference
arXiv:1705.10119
Abstract
Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational posterior. However, existing methods on implicit posteriors still face challenges of noisy estimation and computational infeasibility when applied to models with high-dimensional latent variables. In this paper, we present a new approach named Kernel Implicit Variational Inference that addresses these challenges. As far as we know, for the first time implicit variational inference is successfully applied to Bayesian neural networks, which shows promising results on both regression and classification tasks.
arXiv commentPublished as a conference paper at ICLR 2018
References in corpus (15)
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Weight Uncertainty in Neural Networks
- Adversarial Feature Learning
- Adversarially Learned Inference
- Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm
- Learning in Implicit Generative Models
- Hierarchical Implicit Models and Likelihood-Free Variational Inference
- Improving Variational Auto-Encoders using Householder Flow
- A-NICE-MC: Adversarial Training for MCMC
- Variational Inference using Implicit Distributions
- Gradient Estimators for Implicit Models
- Provable Bayesian Inference via Particle Mirror Descent
- ZhuSuan: A Library for Bayesian Deep Learning
- Overpruning in Variational Bayesian Neural Networks
- Approximate Inference with Amortised MCMC