Learning Approximately Objective Priors
arXiv:1704.01168
Abstract
Informative Bayesian priors are often difficult to elicit, and when this is the case, modelers usually turn to noninformative or objective priors. However, objective priors such as the Jeffreys and reference priors are not tractable to derive for many models of interest. We address this issue by proposing techniques for learning reference prior approximations: we select a parametric family and optimize a black-box lower bound on the reference prior objective to find the member of the family that serves as a good approximation. We experimentally demonstrate the method's effectiveness by recovering Jeffreys priors and learning the Variational Autoencoder's reference prior.
arXiv commentUAI 2017
References in corpus (6)
- Adam: A Method for Stochastic Optimization
- Categorical Reparameterization with Gumbel-Softmax
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
- Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm
- Overall Objective Priors