Analog forecasting of extreme-causing weather patterns using deep learning

Abstract

Numerical weather prediction (NWP) models require ever-growing computing time/resources, but still, have difficulties with predicting weather extremes. Here we introduce a data-driven framework that is based on analog forecasting (prediction using past similar patterns) and employs a novel deep learning pattern-recognition technique (capsule neural networks, CapsNets) and impact-based auto-labeling strategy. CapsNets are trained on mid-tropospheric large-scale circulation patterns (Z500) labeled $0-4$ depending on the existence and geographical region of surface temperature extremes over North America several days ahead. The trained networks predict the occurrence/region of cold or heat waves, only using Z500, with accuracies (recalls) of $69\%-45\%$ $(77\%-48\%)$ or $62\%-41\%$ $(73\%-47\%)$ $1-5$ days ahead. CapsNets outperform simpler techniques such as convolutional neural networks and logistic regression. Using both temperature and Z500, accuracies (recalls) with CapsNets increase to $\sim 80\%$ $(88\%)$, showing the promises of multi-modal data-driven frameworks for accurate/fast extreme weather predictions, which can augment NWP efforts in providing early warnings.

arXiv commentAccepted in Journal of Advances in Modeling Earth System

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• Deep learning to represent sub-grid processes in climate models
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulations
• Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets
• Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events
• Analog forecasting of extreme-causing weather patterns using deep learning
• A test case for application of convolutional neural networks to spatio-temporal climate data: Re-identifying clustered weather patterns
• Spherical CNNs
• Deep learning of mixing by two 'atoms' of stratified turbulence

Cited by in corpus (25)

• Improving data-driven global weather prediction using deep convolutional neural networks on a cubed sphere
• Analog forecasting of extreme-causing weather patterns using deep learning
• A test case for application of convolutional neural networks to spatio-temporal climate data: Re-identifying clustered weather patterns
• Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: Reservoir computing, ANN, and RNN-LSTM
• Quantum Machine Learning for Chemistry and Physics
• Stable a posteriori LES of 2D turbulence using convolutional neural networks: Backscattering analysis and generalization to higher Re via transfer learning
• Deep Learning-based Extreme Heatwave Forecast
• Data-driven subgrid-scale modeling of forced Burgers turbulence using deep learning with generalization to higher Reynolds numbers via transfer learning
• Learning physics-constrained subgrid-scale closures in the small-data regime for stable and accurate LES
• Data-driven super-parameterization using deep learning: Experimentation with multi-scale Lorenz 96 systems and transfer-learning
• Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
• Can AI weather models predict out-of-distribution gray swan tropical cyclones?
• Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformers
• Global Extreme Heat Forecasting Using Neural Weather Models
• Learning forecasts of rare stratospheric transitions from short simulations
• Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case
• Inexact iterative numerical linear algebra for neural network-based spectral estimation and rare-event prediction
• Model-assisted deep learning of rare extreme events from partial observations
• Simple physics and integrators accurately reproduce Mercury instability statistics
• Subgrid-scale parametrization of unresolved scales in forced Burgers equation using Generative Adversarial Networks (GAN)
• Black Hole Weather Forecasting with Deep Learning: A Pilot Study
• Exploiting deep learning in forecasting the occurrence of severe haze in Southeast Asia
• Data-driven geophysical forecasting: Simple, low-cost, and accurate baselines with kernel methods
• Meta-modeling strategy for data-driven forecasting
• Complex Sequential Data Analysis: A Systematic Literature Review of Existing Algorithms