Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Abstract

Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches.

References in corpus (30)

• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Machine Learning for Fluid Mechanics
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
• A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
• Data-assisted reduced-order modeling of extreme events in complex dynamical systems
• Continuous Data Assimilation Using General Interpolant Observables
• Scaling and Dissipation in the GOY Shell Model
• Data-driven recovery of hidden physics in reduced order modeling of fluid flows
• Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization
• A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence
• POD/DEIM Reduced-Order Strategies for Efficient Four Dimensional Variational Data Assimilation
• Data-driven modelling of nonlinear spatio-temporal fluid flows using a deep convolutional generative adversarial network
• Deep convolutional recurrent autoencoders for learning low-dimensional feature dynamics of fluid systems
• Synchronization to big-data: nudging the Navier-Stokes equations for data assimilation of turbulent flows
• Physics-informed Autoencoders for Lyapunov-stable Fluid Flow Prediction
• Inferring flow parameters and turbulent configuration with physics-informed data-assimilation and spectral nudging
• Compressed Convolutional LSTM: An Efficient Deep Learning framework to Model High Fidelity 3D Turbulence
• A reduced-order strategy for 4D-Var data assimilation
• On generalized residue network for deep learning of unknown dynamical systems
• Continuous Data Assimilation Reduced Order Models of Fluid Flow
• Optimal Nonlinear Eddy Viscosity in Galerkin Models of Turbulent Flows
• Cascades and statistical equilibrium in shell models of turbulence
• Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profiles
• Data-Driven Crowd Simulation with Generative Adversarial Networks
• Data-assimilation by delay-coordinate nudging
• Deep Learning and Data Assimilation for Real-Time Production Prediction in Natural Gas Wells
• Trimmed Ensemble Kalman Filter for Nonlinear and Non-Gaussian Data Assimilation Problems

Cited by in corpus (15)

• Physics guided machine learning using simplified theories
• Experimental velocity data estimation for imperfect particle images using machine learning
• Reconstruction of turbulent data with deep generative models for semantic inpainting from TURB-Rot database
• DANSE: Data-driven Non-linear State Estimation of Model-free Process in Unsupervised Learning Setup
• Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformers
• Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems
• State estimation with limited sensors -- A deep learning based approach
• Multifidelity Computing for Coupling Full and Reduced Order Models
• Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case
• Interface learning in fluid dynamics: statistical inference of closures within micro-macro coupling models
• Temporally sparse data assimilation for the small-scale reconstruction of turbulence
• Ensemble data assimilation-based mixed subgrid-scale model for large-eddy simulations
• Interpretable structural model error discovery from sparse assimilation increments using spectral bias-reduced neural networks: A quasi-geostrophic turbulence test case
• Adjoint-based variational optimal mixed models for large-eddy simulation of turbulence
• A Scalable Inference Method For Large Dynamic Economic Systems