Improving ensemble extreme precipitation forecasts using generative artificial intelligence

Abstract

An ensemble post-processing method is developed to improve the probabilistic forecasts of extreme precipitation events across the conterminous United States (CONUS). The method combines a 3-D Vision Transformer (ViT) for bias correction with a Latent Diffusion Model (LDM), a generative Artificial Intelligence (AI) method, to post-process 6-hourly precipitation ensemble forecasts and produce an enlarged generative ensemble that contains spatiotemporally consistent precipitation trajectories. These trajectories are expected to improve the characterization of extreme precipitation events and offer skillful multi-day accumulated and 6-hourly precipitation guidance. The method is tested using the Global Ensemble Forecast System (GEFS) precipitation forecasts out to day 6 and is verified against the Climate-Calibrated Precipitation Analysis (CCPA) data. Verification results indicate that the method generated skillful ensemble members with improved Continuous Ranked Probabilistic Skill Scores (CRPSSs) and Brier Skill Scores (BSSs) over the raw operational GEFS and a multivariate statistical post-processing baseline. It showed skillful and reliable probabilities for events at extreme precipitation thresholds. Explainability studies were further conducted, which revealed the decision-making process of the method and confirmed its effectiveness on ensemble member generation. This work introduces a novel, generative-AI-based approach to address the limitation of small numerical ensembles and the need for larger ensembles to identify extreme precipitation events.

References in corpus (20)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Generative Adversarial Networks: An Overview
• Gaussian Error Linear Units (GELUs)
• Skillful Precipitation Nowcasting using Deep Generative Models of Radar
• Uncertainty Quantification in Complex Simulation Models Using Ensemble Copula Coupling
• Diffusion Models: A Comprehensive Survey of Methods and Applications
• Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models
• GenCast: Diffusion-based ensemble forecasting for medium-range weather
• Vector Quantized Diffusion Model for Text-to-Image Synthesis
• Lossy Image Compression with Conditional Diffusion Models
• PreDiff: Precipitation Nowcasting with Latent Diffusion Models
• Latent diffusion models for generative precipitation nowcasting with accurate uncertainty quantification
• FuXi: A cascade machine learning forecasting system for 15-day global weather forecast
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling
• Precipitation nowcasting with generative diffusion models
• FuXi-Extreme: Improving extreme rainfall and wind forecasts with diffusion model
• Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation
• Diffusion bridges vector quantized Variational AutoEncoders
• Diffusion Model-based Probabilistic Downscaling for 180-year East Asian Climate Reconstruction