Data-Driven Deep Learning of Partial Differential Equations in Modal Space

Abstract

We present a framework for recovering/approximating unknown time-dependent partial differential equation (PDE) using its solution data. Instead of identifying the terms in the underlying PDE, we seek to approximate the evolution operator of the underlying PDE numerically. The evolution operator of the PDE, defined in infinite-dimensional space, maps the solution from a current time to a future time and completely characterizes the solution evolution of the underlying unknown PDE. Our recovery strategy relies on approximation of the evolution operator in a properly defined modal space, i.e., generalized Fourier space, in order to reduce the problem to finite dimensions. The finite dimensional approximation is then accomplished by training a deep neural network structure, which is based on residual network (ResNet), using the given data. Error analysis is provided to illustrate the predictive accuracy of the proposed method. A set of examples of different types of PDEs, including inviscid Burgers' equation that develops discontinuity in its solution, are presented to demonstrate the effectiveness of the proposed method.

Minor notational changes

References in corpus (25)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Solving high-dimensional partial differential equations using deep learning
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• Chaos as an Intermittently Forced Linear System
• Machine Learning of Linear Differential Equations using Gaussian Processes
• PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
• Data Driven Governing Equations Approximation Using Deep Neural Networks
• Solving Many-Electron Schrödinger Equation Using Deep Neural Networks
• PDE-Net: Learning PDEs from Data
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• A deep learning enabler for non-intrusive reduced order modeling of fluid flows
• Simulator-free Solution of High-Dimensional Stochastic Elliptic Partial Differential Equations using Deep Neural Networks
• Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
• A machine learning approach for efficient uncertainty quantification using multiscale methods
• Numerical Aspects for Approximating Governing Equations Using Data
• Efficient Deep Learning Techniques for Multiphase Flow Simulation in Heterogeneous Porous Media
• EM-like Learning Chaotic Dynamics from Noisy and Partial Observations
• NeuPDE: Neural Network Based Ordinary and Partial Differential Equations for Modeling Time-Dependent Data
• IDENT: Identifying Differential Equations with Numerical Time evolution
• Learning to Discretize: Solving 1D Scalar Conservation Laws via Deep Reinforcement Learning

Cited by in corpus (38)

• Weak SINDy For Partial Differential Equations
• The Random Feature Model for Input-Output Maps between Banach Spaces
• Deep learning of free boundary and Stefan problems
• A physics-informed operator regression framework for extracting data-driven continuum models
• Long-term predictions of turbulence by implicit U-Net enhanced Fourier neural operator
• Deep-learning of Parametric Partial Differential Equations from Sparse and Noisy Data
• Attention-Enhanced Neural Network Models for Turbulence Simulation
• Mosaic Flows: A Transferable Deep Learning Framework for Solving PDEs on Unseen Domains
• On quadrature rules for solving Partial Differential Equations using Neural Networks
• GINNs: Graph-Informed Neural Networks for Multiscale Physics
• Bayesian System ID: Optimal management of parameter, model, and measurement uncertainty
• Data-Driven Discovery of Coarse-Grained Equations
• A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks
• Extended Dynamic Mode Decomposition for Inhomogeneous Problems
• WeakIdent: Weak formulation for Identifying Differential Equations using Narrow-fit and Trimming
• Structure-preserving Method for Reconstructing Unknown Hamiltonian Systems from Trajectory Data
• An unsupervised learning approach to solving heat equations on chip based on Auto Encoder and Image Gradient
• Operator Learning Using Random Features: A Tool for Scientific Computing
• Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
• Deep Euler method: solving ODEs by approximating the local truncation error of the Euler method
• Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning
• Cell-average based neural network method for hyperbolic and parabolic partial differential equations
• Discovery of Dynamics Using Linear Multistep Methods
• Bayesian inference of an uncertain generalized diffusion operator
• A learned conservative semi-Lagrangian finite volume scheme for transport simulations
• Data-driven learning of non-autonomous systems
• Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space
• Robust discovery of partial differential equations in complex situations
• The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation
• Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data
• A reduced order Schwarz method for nonlinear multiscale elliptic equations based on two-layer neural networks
• Deep learning of parameterized equations with applications to uncertainty quantification
• Methods to Recover Unknown Processes in Partial Differential Equations Using Data
• Discovering Phase Field Models from Image Data with the Pseudo-spectral Physics Informed Neural Networks
• Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systems
• Multiscale and Nonlocal Learning for PDEs using Densely Connected RNNs
• Toward real-time optimization through model reduction and model discrepancy sensitivities
• MFPC-Net: Multi-fidelity Physics-Constrained Neural Process