A posteriori learning for quasi-geostrophic turbulence parametrization

Abstract

The use of machine learning to build subgrid parametrizations for climate models is receiving growing attention. State-of-the-art strategies address the problem as a supervised learning task and optimize algorithms that predict subgrid fluxes based on information from coarse resolution models. In practice, training data are generated from higher resolution numerical simulations transformed in order to mimic coarse resolution simulations. By essence, these strategies optimize subgrid parametrizations to meet so-called $\text{a priori}$ criteria. But the actual purpose of a subgrid parametrization is to obtain good performance in terms of $\text{a posteriori}$ metrics which imply computing entire model trajectories. In this paper, we focus on the representation of energy backscatter in two dimensional quasi-geostrophic turbulence and compare parametrizations obtained with different learning strategies at fixed computational complexity. We show that strategies based on $\text{a priori}$ criteria yield parametrizations that tend to be unstable in direct simulations and describe how subgrid parametrizations can alternatively be trained end-to-end in order to meet $\text{a posteriori}$ criteria. We illustrate that end-to-end learning strategies yield parametrizations that outperform known empirical and data-driven schemes in terms of performance, stability and ability to apply to different flow configurations. These results support the relevance of differentiable programming paradigms for climate models in the future.

42 pages, 12 figures, accepted for publication in Journal of Advances in Modeling Earth Systems (JAMES)

References in corpus (7)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Learning physics-constrained subgrid-scale closures in the small-data regime for stable and accurate LES
• A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence
• Learning to Control PDEs with Differentiable Physics
• Large-eddy simulations with ClimateMachine: a new open-source code for atmospheric simulations on GPUs and CPUs
• Frame invariant neural network closures for Kraichnan turbulence
• Noether Networks: Meta-Learning Useful Conserved Quantities

Cited by in corpus (19)

• Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow
• Causally-informed deep learning to improve climate models and projections
• Parameterizing Vertical Mixing Coefficients in the Ocean Surface Boundary Layer using Neural Networks
• Generative data-driven approaches for stochastic subgrid parameterizations in an idealized ocean model
• Machine learning for online sea ice bias correction within global ice-ocean simulations
• Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges
• Explainable Offline-Online Training of Neural Networks for Parameterizations: A 1D Gravity Wave-QBO Testbed in the Small-data Regime
• A stable implementation of a data-driven scale-aware mesoscale parameterization
• Subgrid parameterizations of ocean mesoscale eddies based on Germano decomposition
• Development of an offline and online hybrid model for the Integrated Forecasting System
• Interpretable structural model error discovery from sparse assimilation increments using spectral bias-reduced neural networks: A quasi-geostrophic turbulence test case
• Reduced Data-Driven Turbulence Closure for Capturing Long-Term Statistics
• Online learning in idealized ocean gyres
• Electron neural closure for turbulent magnetosheath simulations: energy channels
• Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulence
• NORi: An ML-Augmented Ocean Boundary Layer Parameterization
• The Machine Learning Approach to Moment Closure Relations for Plasma: A Review
• Evaluation of Analytical Turbulence Closures for Quasi-Geostrophic Ocean Flows with Coastal Boundaries
• Data-driven multiscale modeling for correcting dynamical systems