Query Efficient Posterior Estimation in Scientific Experiments via Bayesian Active Learning

Abstract

A common problem in disciplines of applied Statistics research such as Astrostatistics is of estimating the posterior distribution of relevant parameters. Typically, the likelihoods for such models are computed via expensive experiments such as cosmological simulations of the universe. An urgent challenge in these research domains is to develop methods that can estimate the posterior with few likelihood evaluations. In this paper, we study active posterior estimation in a Bayesian setting when the likelihood is expensive to evaluate. Existing techniques for posterior estimation are based on generating samples representative of the posterior. Such methods do not consider efficiency in terms of likelihood evaluations. In order to be query efficient we treat posterior estimation in an active regression framework. We propose two myopic query strategies to choose where to evaluate the likelihood and implement them using Gaussian processes. Via experiments on a series of synthetic and real examples we demonstrate that our approach is significantly more query efficient than existing techniques and other heuristics for posterior estimation.

Published in the Artificial Intelligence Journal (AIJ), Feb 2017 and International Joint Conference on Artificial Intelligence (IJCAI) 2015

References in corpus (7)

• emcee: The MCMC Hammer
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Cosmological Constraints from the SDSS Luminous Red Galaxies
• Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design
• Scrutinizing Exotic Cosmological Models Using ESSENCE Supernova Data Combined with Other Cosmological Probes
• High Dimensional Bayesian Optimisation and Bandits via Additive Models
• A Bayesian model selection analysis of WMAP3

Cited by in corpus (11)

• On The XUV Luminosity Evolution of TRAPPIST-1
• A Flexible Framework for Multi-Objective Bayesian Optimization using Random Scalarizations
• Spectroscopic r-Process Abundance Retrieval for Kilonovae I: The Inferred Abundance Pattern of Early Emission from GW170817
• The DNNLikelihood: enhancing likelihood distribution with Deep Learning
• A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
• Adaptive quadrature schemes for Bayesian inference via active learning
• Batch simulations and uncertainty quantification in Gaussian process surrogate approximate Bayesian computation
• A survey of Monte Carlo methods for noisy and costly densities with application to reinforcement learning and ABC
• Iterative Construction of Gaussian Process Surrogate Models for Bayesian Inference
• Approximate Bayesian inference from noisy likelihoods with Gaussian process emulated MCMC
• Can Global Optimization Strategy Outperform Myopic Strategy for Bayesian Parameter Estimation?