The rise of data-driven weather forecasting

Abstract

Data-driven modeling based on machine learning (ML) is showing enormous potential for weather forecasting. Rapid progress has been made with impressive results for some applications. The uptake of ML methods could be a game-changer for the incremental progress in traditional numerical weather prediction (NWP) known as the 'quiet revolution' of weather forecasting. The computational cost of running a forecast with standard NWP systems greatly hinders the improvements that can be made from increasing model resolution and ensemble sizes. An emerging new generation of ML models, developed using high-quality reanalysis datasets like ERA5 for training, allow forecasts that require much lower computational costs and that are highly-competitive in terms of accuracy. Here, we compare for the first time ML-generated forecasts with standard NWP-based forecasts in an operational-like context, initialized from the same initial conditions. Focusing on deterministic forecasts, we apply common forecast verification tools to assess to what extent a data-driven forecast produced with one of the recently developed ML models (PanguWeather) matches the quality and attributes of a forecast from one of the leading global NWP systems (the ECMWF IFS). The results are very promising, with comparable skill for both global metrics and extreme events, when verified against both the operational analysis and synoptic observations. Increasing forecast smoothness and bias drift with forecast lead time are identified as current drawbacks of ML-based forecasts. A new NWP paradigm is emerging relying on inference from ML models and state-of-the-art analysis and reanalysis datasets for forecast initialization and model training.

References in corpus (3)

• FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators
• GraphCast: Learning skillful medium-range global weather forecasting
• Forecasting Global Weather with Graph Neural Networks

Cited by in corpus (13)

• FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead
• Can AI weather models predict out-of-distribution gray swan tropical cyclones?
• Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Events
• FuXi Weather: A data-to-forecast machine learning system for global weather
• Global spatio-temporal downscaling of ERA5 precipitation through generative AI
• Lightning-Fast Convective Outlooks: Predicting Severe Convective Environments with Global AI-based Weather Models
• Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation
• Leveraging data-driven weather models for improving numerical weather prediction skill through large-scale spectral nudging
• Uncertainty Quantification of Surrogate Models using Conformal Prediction
• AutoPV: Automatically Design Your Photovoltaic Power Forecasting Model
• Spatial verification of global precipitation forecasts
• Green-NAS: A Global-Scale Multi-Objective Neural Architecture Search for Robust and Efficient Edge-Native Weather Forecasting
• Data-driven global ocean model resolving ocean-atmosphere coupling dynamics