Bridging observation, theory and numerical simulation of the ocean using Machine Learning

Abstract

Progress within physical oceanography has been concurrent with the increasing sophistication of tools available for its study. The incorporation of machine learning (ML) techniques offers exciting possibilities for advancing the capacity and speed of established methods and also for making substantial and serendipitous discoveries. Beyond vast amounts of complex data ubiquitous in many modern scientific fields, the study of the ocean poses a combination of unique challenges that ML can help address. The observational data available is largely spatially sparse, limited to the surface, and with few time series spanning more than a handful of decades. Important timescales span seconds to millennia, with strong scale interactions and numerical modelling efforts complicated by details such as coastlines. This review covers the current scientific insight offered by applying ML and points to where there is imminent potential. We cover the main three branches of the field: observations, theory, and numerical modelling. Highlighting both challenges and opportunities, we discuss both the historical context and salient ML tools. We focus on the use of ML in situ sampling and satellite observations, and the extent to which ML applications can advance theoretical oceanographic exploration, as well as aid numerical simulations. Applications that are also covered include model error and bias correction and current and potential use within data assimilation. While not without risk, there is great interest in the potential benefits of oceanographic ML applications; this review caters to this interest within the research community.

arXiv commentTopical review submitted to Environmental Research Letters

References in corpus (34)

• Deep Learning in Neural Networks: An Overview
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Methods for Interpreting and Understanding Deep Neural Networks
• Shortcut Learning in Deep Neural Networks
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Deep learning to represent sub-grid processes in climate models
• Machine learning accelerated computational fluid dynamics
• Neural networks for post-processing ensemble weather forecasts
• Enforcing Analytic Constraints in Neural-Networks Emulating Physical Systems
• Underspecification Presents Challenges for Credibility in Modern Machine Learning
• Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variability
• Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events
• Improving data-driven global weather prediction using deep convolutional neural networks on a cubed sphere
• Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledge
• Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
• Deep Learning for Post-Processing Ensemble Weather Forecasts
• Stochastic Super-Resolution for Downscaling Time-Evolving Atmospheric Fields with a Generative Adversarial Network
• A Review of Innovation-Based Methods to Jointly Estimate Model and Observation Error Covariance Matrices in Ensemble Data Assimilation
• Calibrate, Emulate, Sample
• Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks
• Use of neural networks for stable, accurate and physically consistent parameterization of subgrid atmospheric processes with good performance at reduced precision
• Reconstruction of Sub-Surface Velocities from Satellite Observations Using Iterative Self-Organizing Maps
• Learning dominant physical processes with data-driven balance models
• Ensemble model output statistics for wind vectors
• Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correction
• Physics-informed Autoencoders for Lyapunov-stable Fluid Flow Prediction
• Interpreting and Stabilizing Machine-learning Parametrizations of Convection
• Attention-based Convolutional Autoencoders for 3D-Variational Data Assimilation
• Optimisation of an idealised ocean model, stochastic parameterisation of sub-grid eddies
• Climbing down Charney's ladder: Machine Learning and the post-Dennard era of computational climate science
• Machine learning for total cloud cover prediction
• Analog ensemble data assimilation and a method for constructing analogs with variational autoencoders
• Modern Statistical Methods in Oceanography: A Hierarchical Perspective
• Model error covariance estimation in particle and ensemble Kalman filters using an online expectation-maximization algorithm

Cited by in corpus (6)

• Learning physics-constrained subgrid-scale closures in the small-data regime for stable and accurate LES
• When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System
• Supervised machine learning to estimate instabilities in chaotic systems: estimation of local Lyapunov exponents
• Semi-automatic tuning of coupled climate models with multiple intrinsic timescales: lessons learned from the Lorenz96 model
• Hybrid machine learning data assimilation for marine biogeochemistry
• Assimilation of machine learning-predicted nitrate to improve the quality of phytoplankton forecasting in the shelf sea environment