Computer model validation with functional output

Abstract

A key question in evaluation of computer models is Does the computer model adequately represent reality? A six-step process for computer model validation is set out in Bayarri et al. [Technometrics 49 (2007) 138--154] (and briefly summarized below), based on comparison of computer model runs with field data of the process being modeled. The methodology is particularly suited to treating the major issues associated with the validation process: quantifying multiple sources of error and uncertainty in computer models; combining multiple sources of information; and being able to adapt to different, but related scenarios. Two complications that frequently arise in practice are the need to deal with highly irregular functional data and the need to acknowledge and incorporate uncertainty in the inputs. We develop methodology to deal with both complications. A key part of the approach utilizes a wavelet representation of the functional data, applies a hierarchical version of the scalar validation methodology to the wavelet coefficients, and transforms back, to ultimately compare computer model output with field output. The generality of the methodology is only limited by the capability of a combination of computational tools and the appropriateness of decompositions of the sort (wavelets) employed here. The methods and analyses we present are illustrated with a test bed dynamic stress analysis for a particular engineering system.

Published in at http://dx.doi.org/10.1214/009053607000000163 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (1)

• Computer model validation with functional output

Cited by in corpus (27)

• Computer model validation with functional output
• Determining Fundamental Properties of Matter Created in Ultrarelativistic Heavy-Ion Collisions
• Construction of nested space-filling designs
• Uncertainty quantification for computer models with spatial output using calibration-optimal bases
• Calibrating an ice sheet model using high-dimensional binary spatial data
• Fast dimension-reduced climate model calibration and the effect of data aggregation
• Calibrating a Stochastic Agent Based Model Using Quantile-based Emulation
• Emulating dynamic non-linear simulators using Gaussian processes
• Parameter estimation for computationally intensive nonlinear regression with an application to climate modeling
• Residual Minimizing Model Interpolation for Parameterized Nonlinear Dynamical Systems
• Function-on-function kriging, with applications to 3D printing of aortic tissues
• Consistency Analysis for Massively Inconsistent Datasets in Bound-to-Bound Data Collaboration
• Computer model calibration with large non-stationary spatial outputs: application to the calibration of a climate model
• A Mechanistic Dynamic Emulator
• Emulation of multivariate simulators using thin-plate splines with application to atmospheric dispersion
• Stochastic simulators based optimization by Gaussian process metamodels -- Application to maintenance investments planning issues
• Local Gaussian Process Model for Large-scale Dynamic Computer Experiments
• Posterior Belief Assessment: Extracting Meaningful Subjective Judgements from Bayesian Analyses with Complex Statistical Models
• Prototype selection for parameter estimation in complex models
• A Sequential Design Approach for Calibrating a Dynamic Population Growth Model
• Constructing a simulation surrogate with partially observed output
• Bayesian Functional Emulation of CO2 Emissions on Future Climate Change Scenarios
• Fixed Inducing Points Online Bayesian Calibration for Computer Models with an Application to a Scale-Resolving CFD Simulation
• Gaussian Processes enabled model calibration in the context of deep geological disposal
• Emulating complex dynamical simulators with random Fourier features
• A Framework for the Bayesian Calibration of Complex and Data-Scarce Models in Applied Sciences
• Active Learning with Adaptive Non-Stationary Kernel for Continuous-Fidelity Surrogate Models