Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics

Abstract

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by incorporating physical principles into the model. Most PiDL approaches regularize training by embedding governing equations into the loss function, yet this depends heavily on extensive hyperparameter tuning to weigh each loss term. To this end, we propose to leverage physics prior knowledge by ``baking'' the discretized governing equations into the neural network architecture via the connection between the partial differential equations (PDE) operators and network structures, resulting in a PDE-preserved neural network (PPNN). This method, embedding discretized PDEs through convolutional residual networks in a multi-resolution setting, largely improves the generalizability and long-term prediction accuracy, outperforming conventional black-box models. The effectiveness and merit of the proposed methods have been demonstrated across various spatiotemporal dynamical systems governed by spatiotemporal PDEs, including reaction-diffusion, Burgers', and Navier-Stokes equations.

arXiv comment51 pages, 27 figures

References in corpus (39)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Solving high-dimensional partial differential equations using deep learning
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Fourier Neural Operator for Parametric Partial Differential Equations
• Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
• Machine learning accelerated computational fluid dynamics
• Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
• Learning data driven discretizations for partial differential equations
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures
• Learning to Simulate Complex Physics with Graph Networks
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• A physics-informed variational DeepONet for predicting the crack path in brittle materials
• Stable Architectures for Deep Neural Networks
• Nonlinear mode decomposition with convolutional neural networks for fluid dynamics
• Deep Neural Networks for Data-Driven Turbulence Models
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems
• Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Uncovering near-wall blood flow from sparse data with physics-informed neural networks
• Super-resolution and denoising of fluid flow using physics-informed convolutional neural networks without high-resolution labels
• An artificial neural network framework for reduced order modeling of transient flows
• Construction of Reduced Order Models for Fluid Flows Using Deep Feedforward Neural Networks
• Physics-Informed Neural Operator for Learning Partial Differential Equations
• A Differentiable Programming System to Bridge Machine Learning and Scientific Computing
• Hybrid FEM-NN models: Combining artificial neural networks with the finite element method
• Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism
• Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problems
• FEA-Net: A Physics-guided Data-driven Model for Efficient Mechanical Response Prediction
• Universal Differential Equations for Scientific Machine Learning
• Teaching the Incompressible Navier-Stokes Equations to Fast Neural Surrogate Models in 3D
• Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning
• Variational system identification of the partial differential equations governing microstructure evolution in materials: Inference over sparse and spatially unrelated data
• Uncertainty Quantification and Deep Ensembles

Cited by in corpus (4)

• A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domains
• Scientific machine learning in Hydrology: a unified perspective
• Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flows
• Large strain contribution to the laser-driven magnetization response of magnetostrictive TbFe${}_2$