Simulation-based optimal Bayesian experimental design for nonlinear systems

Abstract

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general mathematical framework and an algorithmic approach for optimal experimental design with nonlinear simulation-based models; in particular, we focus on finding sets of experiments that provide the most information about targeted sets of parameters. Our framework employs a Bayesian statistical setting, which provides a foundation for inference from noisy, indirect, and incomplete data, and a natural mechanism for incorporating heterogeneous sources of information. An objective function is constructed from information theoretic measures, reflecting expected information gain from proposed combinations of experiments. Polynomial chaos approximations and a two-stage Monte Carlo sampling method are used to evaluate the expected information gain. Stochastic approximation algorithms are then used to make optimization feasible in computationally intensive and high-dimensional settings. These algorithms are demonstrated on model problems and on nonlinear parameter estimation problems arising in detailed combustion kinetics.

Preprint 53 pages, 17 figures (54 small figures). v1 submitted to the Journal of Computational Physics on August 4, 2011; v2 submitted on August 12, 2012. v2 changes: (a) addition of Appendix B and Figure 17 to address the bias in the expected utility estimator; (b) minor language edits; v3 submitted on November 30, 2012. v3 changes: minor edits

References in corpus (1)

• Rotating Stars and Revolving Planets: Bayesian Exploration of the Pulsating Sky

Cited by in corpus (66)

• Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identification
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Robust Online Hamiltonian Learning
• Autonomous Discovery of Unknown Reaction Pathways from Data by Chemical Reaction Neural Network
• Gradient-based stochastic optimization methods in Bayesian experimental design
• Fast Bayesian experimental design: Laplace-based importance sampling for the expected information gain
• Bayesian Optimization with Output-Weighted Optimal Sampling
• Goal-Oriented Optimal Design of Experiments for Large-Scale Bayesian Linear Inverse Problems
• Reduced Wiener Chaos representation of random fields via basis adaptation and projection
• Emulation of Higher-Order Tensors in Manifold Monte Carlo Methods for Bayesian Inverse Problems
• Fast computation of uncertainty quantification measures in the geostatistical approach to solve inverse problems
• Fast Bayesian Optimal Experimental Design for Seismic Source Inversion
• mfEGRA: Multifidelity Efficient Global Reliability Analysis through Active Learning for Failure Boundary Location
• Optimal sensor placement for artificial swimmers
• Bayesian Sequential Optimal Experimental Design for Nonlinear Models Using Policy Gradient Reinforcement Learning
• Sequential Bayesian optimal experimental design via approximate dynamic programming
• Quantifying Concordance in Cosmology
• Gaussian process surrogates for failure detection: a Bayesian experimental design approach
• A Bi-fidelity Surrogate Modeling Approach for Uncertainty Propagation in Three-Dimensional Hemodynamic Simulations
• Optimal sensing for fish school identification
• Multilevel Monte Carlo estimation of expected information gains
• Variational Bayesian experimental design for geophysical applications: seismic source location, amplitude versus offset inversion, and estimating CO2 saturations in a subsurface reservoir
• Optimal experimental design under irreducible uncertainty for linear inverse problems governed by PDEs
• Hyper-Differential Sensitivity Analysis for Inverse Problems Constrained by Partial Differential Equations
• Optimal Experimental Design Using A Consistent Bayesian Approach
• Optimal Bayesian experimental design for subsurface flow problems
• Stochastic Learning Approach to Binary Optimization for Optimal Design of Experiments
• A fast and scalable computational framework for large-scale and high-dimensional Bayesian optimal experimental design
• Simplified algorithms for adaptive experiment design in parameter estimation
• Gaussian Process Regression and Conditional Polynomial Chaos for Parameter Estimation
• A layered multiple importance sampling scheme for focused optimal Bayesian experimental design
• Sequentially optimized projections in X-ray imaging
• Variational Bayesian Optimal Experimental Design with Normalizing Flows
• Cyclical Variational Bayes Monte Carlo for Efficient Multi-Modal Posterior Distributions Evaluation
• Residual-Based Error Corrector Operator to Enhance Accuracy and Reliability of Neural Operator Surrogates of Nonlinear Variational Boundary-Value Problems
• Stability estimates for the expected utility in Bayesian optimal experimental design
• Monte Carlo Integration with adaptive variance selection for improved stochastic Efficient Global Optimization
• Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network
• Estimating Global Identifiability Using Conditional Mutual Information in a Bayesian Framework
• Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods
• An approximate KLD based experimental design for models with intractable likelihoods
• Design Analysis for Optimal Calibration of Diffusivity in Reactive Multilayers
• Arrhenius.jl: A Differentiable Combustion SimulationPackage
• Optimal Experimental Design for Constrained Inverse Problems
• Bayesian inference for near-field interferometric tests of collapse models
• A Multi-fidelity Estimator of the Expected Information Gain for Bayesian Optimal Experimental Design
• Real-time adaptive sensing of nuclear spins by a single-spin quantum sensor
• Active Learning of Model Discrepancy with Bayesian Experimental Design
• The Roles of Low-Noise Stations, Arrays and Ocean-Bottom Seismometers in Monitoring UK Offshore Seismicity associated with Subsurface Storage of Carbon Dioxide
• A Framework for Dynamic Image Sampling Based on Supervised Learning (SLADS)
• Optimal Experimental Design for Reliable Learning of History-Dependent Constitutive Laws
• Learning effective good variables from physical data
• Goal-Oriented Bayesian Optimal Experimental Design for Nonlinear Models using Markov Chain Monte Carlo
• Single and Multi-Objective Optimization of Distributed Acoustic Sensing Cable Layouts for Geophysical Applications
• Bayesian optimal design accelerates discovery of material properties from bubble dynamics
• Optimal Experimental Design for Mathematical Models of Hematopoiesis
• Ensemble-Based Experimental Design for Targeting Data Acquisition to Inform Climate Models
• Robust optimal design of large-scale Bayesian nonlinear inverse problems
• Hamiltonian parameter inference from resonant inelastic x-ray scattering with active learning
• Gradient-informed basis adaptation for Legendre Chaos expansions
• Intelligent data collection for network discrimination in material flow analysis using Bayesian optimal experimental design
• Bayesian Optimal Design of Experiments For Inferring The Statistical Expectation Of A Black-Box Function
• Active Inference in Contextual Multi-Armed Bandits for Autonomous Robotic Exploration
• Multimodal Information Gain in Bayesian Design of Experiments
• Learning Arbitrary Quantities of Interest from Expensive Black-Box Functions through Bayesian Sequential Optimal Design
• Sequential Bayesian experiment design for adaptive Ramsey sequence measurements