Optimal experimental design: Formulations and computations

Abstract

Questions of `how best to acquire data' are essential to modeling and prediction in the natural and social sciences, engineering applications, and beyond. Optimal experimental design (OED) formalizes these questions and creates computational methods to answer them. This article presents a systematic survey of modern OED, from its foundations in classical design theory to current research involving OED for complex models. We begin by reviewing criteria used to formulate an OED problem and thus to encode the goal of performing an experiment. We emphasize the flexibility of the Bayesian and decision-theoretic approach, which encompasses information-based criteria that are well-suited to nonlinear and non-Gaussian statistical models. We then discuss methods for estimating or bounding the values of these design criteria; this endeavor can be quite challenging due to strong nonlinearities, high parameter dimension, large per-sample costs, or settings where the model is implicit. A complementary set of computational issues involves optimization methods used to find a design; we discuss such methods in the discrete (combinatorial) setting of observation selection and in settings where an exact design can be continuously parameterized. Finally we present emerging methods for sequential OED that build non-myopic design policies, rather than explicit designs; these methods naturally adapt to the outcomes of past experiments in proposing new experiments, while seeking coordination among all experiments to be performed. Throughout, we highlight important open questions and challenges.

Appears in Acta Numerica 2024. Some corrections and clarifications in this version

Cited by in corpus (17)

• Variational Bayesian Optimal Experimental Design with Normalizing Flows
• Bayesian Model Selection for Network Discrimination and Risk-informed Decision Making in Material Flow Analysis
• Variational Sequential Optimal Experimental Design using Reinforcement Learning
• Multi-Physics-Enhanced Bayesian Inverse Analysis: Information Gain from Additional Fields
• A Multi-fidelity Estimator of the Expected Information Gain for Bayesian Optimal Experimental Design
• Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
• Single and Multi-Objective Optimization of Distributed Acoustic Sensing Cable Layouts for Geophysical Applications
• Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approach
• Approximation of Functions: Optimal Sampling and Complexity
• Optimal Experimental Design for Reliable Learning of History-Dependent Constitutive Laws
• Goal-Oriented Bayesian Optimal Experimental Design for Nonlinear Models using Markov Chain Monte Carlo
• Active learning with physics-informed neural networks for optimal sensor placement in deep tunneling through transversely isotropic elastic rocks
• An Approximate Bayesian Approach to Optimal Input Signal Design for System Identification
• Identifiability Limits in Ultrasonic Microstructure Characterisation: A Canonical and Stochastic Framework
• Data-driven Sensor Placement for Predictive Applications: A Correlation-Assisted Attribution Framework (CAAF)
• Intelligent data collection for network discrimination in material flow analysis using Bayesian optimal experimental design
• Sharp detection of low-dimensional structure in probability measures via dimensional logarithmic Sobolev inequalities