Uncertainty Quantification in Complex Simulation Models Using Ensemble Copula Coupling

Abstract

Critical decisions frequently rely on high-dimensional output from complex computer simulation models that show intricate cross-variable, spatial and temporal dependence structures, with weather and climate predictions being key examples. There is a strongly increasing recognition of the need for uncertainty quantification in such settings, for which we propose and review a general multi-stage procedure called ensemble copula coupling (ECC), proceeding as follows: 1. Generate a raw ensemble, consisting of multiple runs of the computer model that differ in the inputs or model parameters in suitable ways. 2. Apply statistical postprocessing techniques, such as Bayesian model averaging or nonhomogeneous regression, to correct for systematic errors in the raw ensemble, to obtain calibrated and sharp predictive distributions for each univariate output variable individually. 3. Draw a sample from each postprocessed predictive distribution. 4. Rearrange the sampled values in the rank order structure of the raw ensemble to obtain the ECC postprocessed ensemble. The use of ensembles and statistical postprocessing have become routine in weather forecasting over the past decade. We show that seemingly unrelated, recent advances can be interpreted, fused and consolidated within the framework of ECC, the common thread being the adoption of the empirical copula of the raw ensemble. Depending on the use of Quantiles, Random draws or Transformations at the sampling stage, we distinguish the ECC-Q, ECC-R and ECC-T variants, respectively. We also describe relations to the Schaake shuffle and extant copula-based techniques. In a case study, the ECC approach is applied to predictions of temperature, pressure, precipitation and wind over Germany, based on the 50-member European Centre for Medium-Range Weather Forecasts (ECMWF) ensemble.

Published in at http://dx.doi.org/10.1214/13-STS443 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (9)

• Statistical Modeling of Spatial Extremes
• Multivariate Archimedean copulas, $d$-monotone functions and ${\ell }_1$-norm symmetric distributions
• Wind Energy: Forecasting Challenges for Its Operational Management
• Uncertainty Quantification in Complex Simulation Models Using Ensemble Copula Coupling
• Asymptotics of empirical copula processes under non-restrictive smoothness assumptions
• Probabilistic Quantitative Precipitation Forecasting Using Ensemble Model Output Statistics
• Multivariate probabilistic forecasting using Bayesian model averaging and copulas
• Ensemble model output statistics for wind vectors
• Probabilistic quantitative precipitation field forecasting using a two-stage spatial model

Cited by in corpus (38)

• Neural networks for post-processing ensemble weather forecasts
• Uncertainty Quantification in Complex Simulation Models Using Ensemble Copula Coupling
• Statistical Postprocessing for Weather Forecasts -- Review, Challenges and Avenues in a Big Data World
• Spatial postprocessing of ensemble forecasts for temperature using nonhomogeneous Gaussian regression
• A similarity-based implementation of the Schaake shuffle
• Isotonic Distributional Regression
• From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting
• Scenario-based Nonlinear Model Predictive Control for Building Heating Systems
• Generation of scenarios from calibrated ensemble forecasts with a dual ensemble copula coupling approach
• Joint probabilistic forecasting of wind speed and temperature using Bayesian model averaging
• Probabilistic temperature forecasting based on an ensemble AR modification
• Comparison of multivariate post-processing methods using global ECMWF ensemble forecasts
• Forecasting: theory and practice
• Generative machine learning methods for multivariate ensemble post-processing
• Machine learning methods for postprocessing ensemble forecasts of wind gusts: A systematic comparison
• Cholesky-based multivariate Gaussian regression
• Statistical post-processing of hydrological forecasts using Bayesian model averaging
• Evaluating Ensemble Post-Processing for Wind Power Forecasts
• Bivariate ensemble model output statistics approach for joint forecasting of wind speed and temperature
• Probabilistic Temperature Forecasting with a Heteroscedastic Autoregressive Ensemble Postprocessing model
• Bivariate Gaussian models for wind vectors in a distributional regression framework
• Statistical post-processing of heat index ensemble forecasts: is there a royal road?
• On Classification Issues within Ensemble-Based Complex System Simulation Tasks
• Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation
• A two-step machine learning approach to statistical post-processing of weather forecasts for power generation
• Machine learning-based probabilistic forecasting of solar irradiance in Chile
• Computational Rational Engineering and Development: Synergies and Opportunities
• Clustering-based spatial interpolation of parametric post-processing models
• Improving ensemble extreme precipitation forecasts using generative artificial intelligence
• Rapid adjustment and post-processing of temperature forecast trajectories
• Generating Synthetic Rainfall Fields by R-vine Copulas Applied to Seamless Probabilistic Predictions
• Self-Attentive Ensemble Transformer: Representing Ensemble Interactions in Neural Networks for Earth System Models
• Enhancing multivariate post-processed visibility predictions utilizing CAMS forecasts
• A Composite-Loss Graph Neural Network for the Multivariate Post-Processing of Ensemble Weather Forecasts
• Post-processing multi-ensemble temperature and precipitation forecasts through an Exchangeable Gamma Normal model and its Tobit extension
• Ensemble size dependence of the logarithmic score for forecasts issued as multivariate normal distributions
• Bayesian Motion Estimation for Dust Aerosols
• Leveraging deterministic weather forecasts for in-situ probabilistic temperature predictions via deep learning