Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods
arXiv:2111.02329
Abstract
We introduce implicit Deep Adaptive Design (iDAD), a new method for performing adaptive experiments in real-time with implicit models. iDAD amortizes the cost of Bayesian optimal experimental design (BOED) by learning a design policy network upfront, which can then be deployed quickly at the time of the experiment. The iDAD network can be trained on any model which simulates differentiable samples, unlike previous design policy work that requires a closed form likelihood and conditionally independent experiments. At deployment, iDAD allows design decisions to be made in milliseconds, in contrast to traditional BOED approaches that require heavy computation during the experiment itself. We illustrate the applicability of iDAD on a number of experiments, and show that it provides a fast and effective mechanism for performing adaptive design with implicit models.
33 pages, 8 figures. Published as a conference paper at NeurIPS 2021
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Learning Representations by Maximizing Mutual Information Across Views
- Estimating divergence functionals and the likelihood ratio by convex risk minimization
- Simulation-based optimal Bayesian experimental design for nonlinear systems
- On Variational Bounds of Mutual Information
- Quantifying the Carbon Emissions of Machine Learning
- Gradient-based stochastic optimization methods in Bayesian experimental design
- Variational Bayesian Optimal Experimental Design
- On Nesting Monte Carlo Estimators
- Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds