Time-series learning of latent-space dynamics for reduced-order model closure

Abstract

We study the performance of long short-term memory networks (LSTMs) and neural ordinary differential equations (NODEs) in learning latent-space representations of dynamical equations for an advection-dominated problem given by the viscous Burgers equation. Our formulation is devised in a non-intrusive manner with an equation-free evolution of dynamics in a reduced space with the latter being obtained through a proper orthogonal decomposition. In addition, we leverage the sequential nature of learning for both LSTMs and NODEs to demonstrate their capability for closure in systems which are not completely resolved in the reduced space. We assess our hypothesis for two advection-dominated problems given by the viscous Burgers equation. It is observed that both LSTMs and NODEs are able to reproduce the effects of the absent scales for our test cases more effectively than intrusive dynamics evolution through a Galerkin projection. This result empirically suggests that time-series learning techniques implicitly leverage a memory kernel for coarse-grained system closure as is suggested through the Mori-Zwanzig formalism.

References in corpus (21)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Deep learning for universal linear embeddings of nonlinear dynamics
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• Data-driven discovery of coordinates and governing equations
• Neural Ordinary Differential Equations
• Burgers Turbulence
• Stable Architectures for Deep Neural Networks
• Proper Orthogonal Decomposition Closure Models For Turbulent Flows: A Numerical Comparison
• Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
• An artificial neural network framework for reduced order modeling of transient flows
• Invertible Residual Networks
• A Deep Learning based Approach to Reduced Order Modeling for Turbulent Flow Control using LSTM Neural Networks
• Deep learning algorithm for data-driven simulation of noisy dynamical system
• Extreme learning machine for reduced order modeling of turbulent geophysical flows
• Physically-Constrained Data-Driven, Filtered Reduced Order Modeling of Fluid Flows
• Compressed Convolutional LSTM: An Efficient Deep Learning framework to Model High Fidelity 3D Turbulence
• Evaluation of explicit and implicit LES closures for Burgers turbulence
• Robust learning with implicit residual networks
• Model Reduction with Memory and the Machine Learning of Dynamical Systems
• Stationary two-dimensional turbulence statistics using a Markovian forcing scheme
• Using recurrent neural networks for nonlinear component computation in advection-dominated reduced-order models

Cited by in corpus (46)

• Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
• Assessment of supervised machine learning methods for fluid flows
• Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
• Convolutional neural network based hierarchical autoencoder for nonlinear mode decomposition of fluid field data
• Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamics
• Stiff Neural Ordinary Differential Equations
• Probabilistic neural networks for fluid flow surrogate modeling and data recovery
• The Neural Particle Method -- An Updated Lagrangian Physics Informed Neural Network for Computational Fluid Dynamics
• Assessment of unsteady flow predictions using hybrid deep learning based reduced order models
• Data-driven discovery of intrinsic dynamics
• Experimental velocity data estimation for imperfect particle images using machine learning
• Data-Driven Variational Multiscale Reduced Order Models
• Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systems
• Machine Learning for Prediction with Missing Dynamics
• Data-Driven Reduced-Order Modeling of Spatiotemporal Chaos with Neural Ordinary Differential Equations
• Parameterized Neural Ordinary Differential Equations: Applications to Computational Physics Problems
• Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning
• Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
• Neural-network learning of SPOD latent dynamics
• Data-Driven Correction Reduced Order Models for the Quasi-Geostrophic Equations: A Numerical Investigation
• Turbulence forecasting via Neural ODE
• Neural Closure Models for Dynamical Systems
• Calibrating hypersonic turbulence flow models with the HIFiRE-1 experiment using data-driven machine-learned models
• Extracting Stochastic Governing Laws by Nonlocal Kramers-Moyal Formulas
• CD-ROM: Complemented Deep-Reduced Order Model
• Machine Learning-Based Statistical Closure Models for Turbulent Dynamical Systems
• Reconstructing three-dimensional bluff body wake from sectional flow fields with convolutional neural networks
• Neural Dynamical Operator: Continuous Spatial-Temporal Model with Gradient-Based and Derivative-Free Optimization Methods
• A Tailored Convolutional Neural Network for Nonlinear Manifold Learning of Computational Physics Data using Unstructured Spatial Discretizations
• CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation
• Machine learning structure preserving brackets for forecasting irreversible processes
• Reduced-order Model for Fluid Flows via Neural Ordinary Differential Equations
• Learning Stable Galerkin Models of Turbulence with Differentiable Programming
• Limits of Learning Dynamical Systems
• Neural Ordinary Differential Equations for Data-Driven Reduced Order Modeling of Environmental Hydrodynamics
• Conditionally Parameterized, Discretization-Aware Neural Networks for Mesh-Based Modeling of Physical Systems
• Rapidly Encoding Generalizable Dynamics in a Euclidean Symmetric Neural Network
• Reduced order modeling of fluid flows: Machine learning, Kolmogorov barrier, closure modeling, and partitioning
• Model order reduction with neural networks: Application to laminar and turbulent flows
• Data-driven discovery of quasiperiodically driven dynamics
• Data-driven geophysical forecasting: Simple, low-cost, and accurate baselines with kernel methods
• Meta-modeling strategy for data-driven forecasting
• Machine-Learning for Nonintrusive Model Order Reduction of the Parametric Inviscid Transonic Flow past an airfoil
• Using recurrent neural networks for nonlinear component computation in advection-dominated reduced-order models
• Closure Learning for Nonlinear Model Reduction Using Deep Residual Neural Network
• Adaptive Machine Learning for Time-Varying Systems: Low Dimensional Latent Space Tuning