Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics

Abstract

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by incorporating physical principles into the model. Most PiDL approaches regularize training by embedding governing equations into the loss function, yet this depends heavily on extensive hyperparameter tuning to weigh each loss term. To this end, we propose to leverage physics prior knowledge by ``baking'' the discretized governing equations into the neural network architecture via the connection between the partial differential equations (PDE) operators and network structures, resulting in a PDE-preserved neural network (PPNN). This method, embedding discretized PDEs through convolutional residual networks in a multi-resolution setting, largely improves the generalizability and long-term prediction accuracy, outperforming conventional black-box models. The effectiveness and merit of the proposed methods have been demonstrated across various spatiotemporal dynamical systems governed by spatiotemporal PDEs, including reaction-diffusion, Burgers', and Navier-Stokes equations.

51 pages, 27 figures

References in corpus (15)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Fourier Neural Operator for Parametric Partial Differential Equations
• Machine learning accelerated computational fluid dynamics
• A physics-informed variational DeepONet for predicting the crack path in brittle materials
• Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Uncovering near-wall blood flow from sparse data with physics-informed neural networks
• Super-resolution and denoising of fluid flow using physics-informed convolutional neural networks without high-resolution labels
• Construction of Reduced Order Models for Fluid Flows Using Deep Feedforward Neural Networks
• Physics-Informed Neural Operator for Learning Partial Differential Equations
• A Differentiable Programming System to Bridge Machine Learning and Scientific Computing
• Hybrid FEM-NN models: Combining artificial neural networks with the finite element method
• Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism
• Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problems
• Teaching the Incompressible Navier-Stokes Equations to Fast Neural Surrogate Models in 3D

Cited by in corpus (4)

• A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domains
• Scientific machine learning in Hydrology: a unified perspective
• Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flows
• Large strain contribution to the laser-driven magnetization response of magnetostrictive TbFe${}_2$