DR-RNN: A deep residual recurrent neural network for model reduction

Abstract

We introduce a deep residual recurrent neural network (DR-RNN) as an efficient model reduction technique for nonlinear dynamical systems. The developed DR-RNN is inspired by the iterative steps of line search methods in finding the residual minimiser of numerically discretized differential equations. We formulate this iterative scheme as stacked recurrent neural network (RNN) embedded with the dynamical structure of the emulated differential equations. Numerical examples demonstrate that DR-RNN can effectively emulate the full order models of nonlinear physical systems with a significantly lower number of parameters in comparison to standard RNN architectures. Further, we combined DR-RNN with Proper Orthogonal Decomposition (POD) for model reduction of time dependent partial differential equations. The presented numerical results show the stability of proposed DR-RNN as an explicit reduced order technique. We also show significant gains in accuracy by increasing the depth of proposed DR-RNN similar to other applications of deep learning.

References in corpus (3)

• A Critical Review of Recurrent Neural Networks for Sequence Learning
• How to Construct Deep Recurrent Neural Networks
• Learning Longer Memory in Recurrent Neural Networks

Cited by in corpus (19)

• Improving aircraft performance using machine learning: a review
• A deep learning enabler for non-intrusive reduced order modeling of fluid flows
• An artificial neural network framework for reduced order modeling of transient flows
• A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic
• PFNN: A Penalty-Free Neural Network Method for Solving a Class of Second-Order Boundary-Value Problems on Complex Geometries
• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• Assessment of unsteady flow predictions using hybrid deep learning based reduced order models
• A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence
• Deep learning-based reduced order models in cardiac electrophysiology
• Injecting Knowledge in Data-driven Vehicle Trajectory Predictors
• Memory embedded non-intrusive reduced order modeling of non-ergodic flows
• Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning
• Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profiles
• A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
• Model Order Reduction based on Runge-Kutta Neural Network
• Probabilistic model-error assessment of deep learning proxies: an application to real-time inversion of borehole electromagnetic measurements
• POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition
• Learning Green's Functions of Linear Reaction-Diffusion Equations with Application to Fast Numerical Solver
• Adaptive POD Galerkin technique for reservoir simulation and optimization