A posteriori learning for quasi-geostrophic turbulence parametrization

Abstract

The use of machine learning to build subgrid parametrizations for climate models is receiving growing attention. State-of-the-art strategies address the problem as a supervised learning task and optimize algorithms that predict subgrid fluxes based on information from coarse resolution models. In practice, training data are generated from higher resolution numerical simulations transformed in order to mimic coarse resolution simulations. By essence, these strategies optimize subgrid parametrizations to meet so-called $\text{a priori}$ criteria. But the actual purpose of a subgrid parametrization is to obtain good performance in terms of $\text{a posteriori}$ metrics which imply computing entire model trajectories. In this paper, we focus on the representation of energy backscatter in two dimensional quasi-geostrophic turbulence and compare parametrizations obtained with different learning strategies at fixed computational complexity. We show that strategies based on $\text{a priori}$ criteria yield parametrizations that tend to be unstable in direct simulations and describe how subgrid parametrizations can alternatively be trained end-to-end in order to meet $\text{a posteriori}$ criteria. We illustrate that end-to-end learning strategies yield parametrizations that outperform known empirical and data-driven schemes in terms of performance, stability and ability to apply to different flow configurations. These results support the relevance of differentiable programming paradigms for climate models in the future.

arXiv comment42 pages, 12 figures, accepted for publication in Journal of Advances in Modeling Earth Systems (JAMES)

References in corpus (35)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Machine Learning for Fluid Mechanics
• Machine learning and the physical sciences
• DGM: A deep learning algorithm for solving partial differential equations
• Deep learning to represent sub-grid processes in climate models
• Machine learning accelerated computational fluid dynamics
• Neural Ordinary Differential Equations
• Group Equivariant Convolutional Networks
• Deep Neural Networks for Data-Driven Turbulence Models
• Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulations
• Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events
• Sub-grid modelling for two-dimensional turbulence using neural networks
• Searching for turbulence models by artificial neural network
• Training convolutional neural networks to estimate turbulent sub-grid scale reaction rates
• Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models
• Using machine learning to correct model error in data assimilation and forecast applications
• Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solvers
• Stable a posteriori LES of 2D turbulence using convolutional neural networks: Backscattering analysis and generalization to higher Re via transfer learning
• Learning Variational Data Assimilation Models and Solvers
• Deconvolutional artificial neural network models for large eddy simulation of turbulence
• Embedded training of neural-network sub-grid-scale turbulence models
• Learning physics-constrained subgrid-scale closures in the small-data regime for stable and accurate LES
• Machine learning emulation of gravity wave drag in numerical weather forecasting
• Energy and enstrophy spectra and fluxes for the inertial-dissipation range of two-dimensional turbulence
• A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence
• Machine Learning Emulation of 3D Cloud Radiative Effects
• Learning to Control PDEs with Differentiable Physics
• Physical invariance in neural networks for subgrid-scale scalar flux modeling
• A framework for the evaluation of turbulence closures used in mesoscale ocean large-eddy simulations
• Interpreting neural network models of residual scalar flux
• Data-Driven Discovery of Coarse-Grained Equations
• Large-eddy simulations with ClimateMachine: a new open-source code for atmospheric simulations on GPUs and CPUs
• Frame invariant neural network closures for Kraichnan turbulence
• Noether Networks: Meta-Learning Useful Conserved Quantities

Cited by in corpus (19)

• Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow
• Causally-informed deep learning to improve climate models and projections
• Parameterizing Vertical Mixing Coefficients in the Ocean Surface Boundary Layer using Neural Networks
• Generative data-driven approaches for stochastic subgrid parameterizations in an idealized ocean model
• Machine learning for online sea ice bias correction within global ice-ocean simulations
• Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges
• Explainable Offline-Online Training of Neural Networks for Parameterizations: A 1D Gravity Wave-QBO Testbed in the Small-data Regime
• A stable implementation of a data-driven scale-aware mesoscale parameterization
• Subgrid parameterizations of ocean mesoscale eddies based on Germano decomposition
• Development of an offline and online hybrid model for the Integrated Forecasting System
• Interpretable structural model error discovery from sparse assimilation increments using spectral bias-reduced neural networks: A quasi-geostrophic turbulence test case
• Reduced Data-Driven Turbulence Closure for Capturing Long-Term Statistics
• Online learning in idealized ocean gyres
• Electron neural closure for turbulent magnetosheath simulations: energy channels
• Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulence
• NORi: An ML-Augmented Ocean Boundary Layer Parameterization
• The Machine Learning Approach to Moment Closure Relations for Plasma: A Review
• Evaluation of Analytical Turbulence Closures for Quasi-Geostrophic Ocean Flows with Coastal Boundaries
• Data-driven multiscale modeling for correcting dynamical systems