Gradient-based stochastic optimization methods in Bayesian experimental design

Abstract

Optimal experimental design (OED) seeks experiments expected to yield the most useful data for some purpose. In practical circumstances where experiments are time-consuming or resource-intensive, OED can yield enormous savings. We pursue OED for nonlinear systems from a Bayesian perspective, with the goal of choosing experiments that are optimal for parameter inference. Our objective in this context is the expected information gain in model parameters, which in general can only be estimated using Monte Carlo methods. Maximizing this objective thus becomes a stochastic optimization problem. This paper develops gradient-based stochastic optimization methods for the design of experiments on a continuous parameter space. Given a Monte Carlo estimator of expected information gain, we use infinitesimal perturbation analysis to derive gradients of this estimator. We are then able to formulate two gradient-based stochastic optimization approaches: (i) Robbins-Monro stochastic approximation, and (ii) sample average approximation combined with a deterministic quasi-Newton method. A polynomial chaos approximation of the forward model accelerates objective and gradient evaluations in both cases. We discuss the implementation of these optimization methods, then conduct an empirical comparison of their performance. To demonstrate design in a nonlinear setting with partial differential equation forward models, we use the problem of sensor placement for source inversion. Numerical results yield useful guidelines on the choice of algorithm and sample sizes, assess the impact of estimator bias, and quantify tradeoffs of computational cost versus solution quality and robustness.

Preprint 40 pages, 10 figures (121 small figures). v1 submitted to the International Journal for Uncertainty Quantification on December 10, 2012; v2 submitted on September 10, 2013. v2 changes: (a) clarified algorithm stopping criteria and other parameters; (b) emphasized paper contributions, plus other minor edits; v3 submitted on December 26, 2014. v3 changes: minor edits

References in corpus (2)

• Simulation-based optimal Bayesian experimental design for nonlinear systems
• Sparse Pseudospectral Approximation Method

Cited by in corpus (27)

• Goal-Oriented Optimal Design of Experiments for Large-Scale Bayesian Linear Inverse Problems
• Sequential Bayesian optimal experimental design via approximate dynamic programming
• A Bi-fidelity Surrogate Modeling Approach for Uncertainty Propagation in Three-Dimensional Hemodynamic Simulations
• Output-weighted optimal sampling for Bayesian regression and rare event statistics using few samples
• Variational Bayesian experimental design for geophysical applications: seismic source location, amplitude versus offset inversion, and estimating CO2 saturations in a subsurface reservoir
• Uncertainty Analysis of Microsegregation during Laser Powder Bed Fusion
• Optimal Experimental Design Using A Consistent Bayesian Approach
• Stochastic Learning Approach to Binary Optimization for Optimal Design of Experiments
• A fast and scalable computational framework for large-scale and high-dimensional Bayesian optimal experimental design
• Unbiased MLMC stochastic gradient-based optimization of Bayesian experimental designs
• A layered multiple importance sampling scheme for focused optimal Bayesian experimental design
• Variational Bayesian Optimal Experimental Design with Normalizing Flows
• Sequentially optimized projections in X-ray imaging
• Variational Bayesian strategies for high-dimensional, stochastic design problems
• Stability estimates for the expected utility in Bayesian optimal experimental design
• Deep Adaptive Design: Amortizing Sequential Bayesian Experimental Design
• Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods
• Design Analysis for Optimal Calibration of Diffusivity in Reactive Multilayers
• Active Learning of Model Discrepancy with Bayesian Experimental Design
• Bayesian optimal design accelerates discovery of material properties from bubble dynamics
• Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approach
• Goal-Oriented Bayesian Optimal Experimental Design for Nonlinear Models using Markov Chain Monte Carlo
• Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
• Bayesian Experimental Design for Oral Glucose Tolerance Tests (OGTT)
• Ensemble-Based Experimental Design for Targeting Data Acquisition to Inform Climate Models
• Learning Arbitrary Quantities of Interest from Expensive Black-Box Functions through Bayesian Sequential Optimal Design
• Bayesian Optimal Design of Experiments For Inferring The Statistical Expectation Of A Black-Box Function