A test case for application of convolutional neural networks to spatio-temporal climate data: Re-identifying clustered weather patterns

Abstract

Convolutional neural networks (CNNs) can potentially provide powerful tools for classifying and identifying patterns in climate and environmental data. However, because of the inherent complexities of such data, which are often spatio-temporal, chaotic, and non-stationary, the CNN algorithms must be designed/evaluated for each specific dataset and application. Yet to start, CNN, a supervised technique, requires a large labeled dataset. Labeling demands (human) expert time, which combined with the limited number of relevant examples in this area, can discourage using CNNs for new problems. To address these challenges, here we (1) Propose an effective auto-labeling strategy based on using an unsupervised clustering algorithm and evaluating the performance of CNNs in re-identifying these clusters; (2) Use this approach to label thousands of daily large-scale weather patterns over North America in the outputs of a fully-coupled climate model and show the capabilities of CNNs in re-identifying the 4 clustered regimes. The deep CNN trained with $1000$ samples or more per cluster has an accuracy of $90\%$ or better. Accuracy scales monotonically but nonlinearly with the size of the training set, e.g. reaching $94\%$ with $3000$ training samples per cluster. Effects of architecture and hyperparameters on the performance of CNNs are examined and discussed.

References in corpus (7)

• Deep learning to represent sub-grid processes in climate models
• Neural networks for post-processing ensemble weather forecasts
• Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events
• Analog forecasting of extreme-causing weather patterns using deep learning
• Data-driven reduced modelling of turbulent Rayleigh-Benard convection using DMD-enhanced Fluctuation-Dissipation Theorem
• Quantifying the eddy-jet feedback strength of the annular mode in an idealized GCM and reanalysis data
• Reduced-order modeling of fully turbulent buoyancy-driven flows using the Green's function method

Cited by in corpus (10)

• Will Artificial Intelligence supersede Earth System and Climate Models?
• Analog forecasting of extreme-causing weather patterns using deep learning
• Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: Reservoir computing, ANN, and RNN-LSTM
• Stable a posteriori LES of 2D turbulence using convolutional neural networks: Backscattering analysis and generalization to higher Re via transfer learning
• Data-driven super-parameterization using deep learning: Experimentation with multi-scale Lorenz 96 systems and transfer-learning
• Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
• Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformers
• Deep Learning-Based Spatiotemporal Multi-Event Reconstruction for Delay Line Detectors
• Climate Modeling with Neural Diffusion Equations
• Meta-modeling strategy for data-driven forecasting