A long short-term memory embedding for hybrid uplifted reduced order models

Abstract

In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model to account for residuals beyond this truncation. This closure layer refers to the process of including the residual effect of the discarded modes into the dynamics of the largest scales. However, the feasibility of generating a low rank approximation tails off for higher Kolmogorov $n$-width systems due to the underlying nonlinear processes. The third uplifting layer, called super-resolution, addresses this limited representation issue by expanding the span into a larger number of modes utilizing the versatility of LSTM. Therefore, our model integrates a physics-based projection model with a memory embedded LSTM closure and an LSTM based super-resolution model. In several applications, we exploit the use of Grassmann manifold to construct UROM for unseen conditions. We performed numerical experiments by using the Burgers and Navier-Stokes equations with quadratic nonlinearity. Our results show robustness of the proposed approach in building reduced order models for parameterized systems and confirm the improved trade-off between accuracy and efficiency.

References in corpus (29)

• Machine Learning for Fluid Mechanics
• Turbulence Modeling in the Age of Data
• Deep learning for universal linear embeddings of nonlinear dynamics
• Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control
• Proper Orthogonal Decomposition Closure Models For Turbulent Flows: A Numerical Comparison
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Model
• Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
• Cluster-based reduced-order modelling of a mixing layer
• Data-assisted reduced-order modeling of extreme events in complex dynamical systems
• On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high Reynolds number flow over an Ahmed body
• Deep Learning for Time-Series Analysis
• A Deep Learning based Approach to Reduced Order Modeling for Turbulent Flow Control using LSTM Neural Networks
• Nonlinear Model Order Reduction via Lifting Transformations and Proper Orthogonal Decomposition
• On the stability of projection-based model order reduction for convection-dominated laminar and turbulent flows
• Deep learning algorithm for data-driven simulation of noisy dynamical system
• Comparison of POD reduced order strategies for the nonlinear 2D Shallow Water Equations
• Data-driven recovery of hidden physics in reduced order modeling of fluid flows
• A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence
• pyMOR - Generic Algorithms and Interfaces for Model Order Reduction
• Physically-Constrained Data-Driven, Filtered Reduced Order Modeling of Fluid Flows
• A stabilized proper orthogonal decomposition reduced-order model for large scale quasigeostrophic ocean circulation
• Proper orthogonal decomposition closure models for fluid flows: Burgers equation
• Memory embedded non-intrusive reduced order modeling of non-ergodic flows
• Optimal Nonlinear Eddy Viscosity in Galerkin Models of Turbulent Flows
• A Localized Reduced-Order Modeling Approach for PDEs with Bifurcating Solutions
• Multiobjective Optimal Control Methods for Fluid Flow Using Reduced Order Modeling
• Manifold interpolation and model reduction
• Non intrusive method for parametric model order reduction using a bi-calibrated interpolation on the Grassmann manifold

Cited by in corpus (17)

• Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
• Deep Neural Networks for Nonlinear Model Order Reduction of Unsteady Flows
• Probabilistic neural networks for fluid flow surrogate modeling and data recovery
• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• Physics guided machine learning using simplified theories
• Nonlinear proper orthogonal decomposition for convection-dominated flows
• Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression
• Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
• $\text{FastSVD-ML-ROM}$: A Reduced-Order Modeling Framework based on Machine Learning for Real-Time Applications
• Multifidelity Computing for Coupling Full and Reduced Order Models
• Numerical assessments of a nonintrusive surrogate model based on recurrent neural networks and proper orthogonal decomposition: Rayleigh Benard convection
• Learning Stable Galerkin Models of Turbulence with Differentiable Programming
• Reduced Order Models for the Quasi-Geostrophic Equations: A Brief Survey
• Online adaptive basis construction for nonlinear model reduction through local error optimization
• Solving time-dependent parametric PDEs by multiclass classification-based reduced order model
• A non-intrusive reduced-order modelling for uncertainty propagation of time-dependent problems using a B-splines Bézier elements-based method and Proper Orthogonal Decomposition: application to dam-break flows
• On the dual advantage of placing observations through forward sensitivity analysis