Statistical Postprocessing for Weather Forecasts -- Review, Challenges and Avenues in a Big Data World

Abstract

Statistical postprocessing techniques are nowadays key components of the forecasting suites in many National Meteorological Services (NMS), with for most of them, the objective of correcting the impact of different types of errors on the forecasts. The final aim is to provide optimal, automated, seamless forecasts for end users. Many techniques are now flourishing in the statistical, meteorological, climatological, hydrological, and engineering communities. The methods range in complexity from simple bias corrections to very sophisticated distribution-adjusting techniques that incorporate correlations among the prognostic variables. The paper is an attempt to summarize the main activities going on this area from theoretical developments to operational applications, with a focus on the current challenges and potential avenues in the field. Among these challenges is the shift in NMS towards running ensemble Numerical Weather Prediction (NWP) systems at the kilometer scale that produce very large datasets and require high-density high-quality observations; the necessity to preserve space time correlation of high-dimensional corrected fields; the need to reduce the impact of model changes affecting the parameters of the corrections; the necessity for techniques to merge different types of forecasts and ensembles with different behaviors; and finally the ability to transfer research on statistical postprocessing to operations. Potential new avenues will also be discussed.

This work has been submitted to the Bulletin of the American Meteorological Society. Copyright in this work may be transferred without further notice

References in corpus (1)

• Statistical post-processing of wind speed forecasts using convolutional neural networks

Cited by in corpus (21)

• A review of predictive uncertainty estimation with machine learning
• A comparative study of convolutional neural network models for wind field downscaling
• Post-processing numerical weather prediction ensembles for probabilistic solar irradiance forecasting
• Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamics
• From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting
• Comparison of multivariate post-processing methods using global ECMWF ensemble forecasts
• Generative machine learning methods for multivariate ensemble post-processing
• Evaluating Ensemble Post-Processing for Wind Power Forecasts
• Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification
• Postprocessing of point predictions for probabilistic forecasting of day-ahead electricity prices: The benefits of using isotonic distributional regression
• Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation
• Comparing Sequential Forecasters
• A two-step machine learning approach to statistical post-processing of weather forecasts for power generation
• Machine learning-based probabilistic forecasting of solar irradiance in Chile
• Statistical post-processing of visibility ensemble forecasts
• Site-specific Deterministic Temperature and Humidity Forecasts with Explainable and Reliable Machine Learning
• Enhancing multivariate post-processed visibility predictions utilizing CAMS forecasts
• A Composite-Loss Graph Neural Network for the Multivariate Post-Processing of Ensemble Weather Forecasts
• Post-processing of ensemble photovoltaic power forecasts with distributional and quantile regression methods
• Parametric model for post-processing visibility ensemble forecasts
• Achieving Skilled and Reliable Daily Probabilistic Forecasts of Wind Power at Subseasonal-to-Seasonal Timescales over France