PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs

Abstract

Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks (PINNs) to solve PDEs as a basis for data-driven modeling and inverse analysis. However, the majority of existing PINN methods, based on fully-connected NNs, pose intrinsic limitations to low-dimensional spatiotemporal parameterizations. Moreover, since the initial/boundary conditions (I/BCs) are softly imposed via penalty, the solution quality heavily relies on hyperparameter tuning. To this end, we propose the novel physics-informed convolutional-recurrent learning architectures (PhyCRNet and PhyCRNet-s) for solving PDEs without any labeled data. Specifically, an encoder-decoder convolutional long short-term memory network is proposed for low-dimensional spatial feature extraction and temporal evolution learning. The loss function is defined as the aggregated discretized PDE residuals, while the I/BCs are hard-encoded in the network to ensure forcible satisfaction (e.g., periodic boundary padding). The networks are further enhanced by autoregressive and residual connections that explicitly simulate time marching. The performance of our proposed methods has been assessed by solving three nonlinear PDEs (e.g., 2D Burgers' equations, the $\lambda$-$\omega$ and FitzHugh Nagumo reaction-diffusion equations), and compared against the start-of-the-art baseline algorithms. The numerical results demonstrate the superiority of our proposed methodology in the context of solution accuracy, extrapolability and generalizability.

arXiv comment22 pages

References in corpus (45)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Sequence to Sequence Learning with Neural Networks
• Semi-Supervised Classification with Graph Convolutional Networks
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Geometric deep learning: going beyond Euclidean data
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Machine Learning for Fluid Mechanics
• DeepXDE: A deep learning library for solving differential equations
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications
• Solving high-dimensional partial differential equations using deep learning
• Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Fourier Neural Operator for Parametric Partial Differential Equations
• Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Physics-informed learning of governing equations from scarce data
• Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networks
• Learning data driven discretizations for partial differential equations
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures
• Simulation-based optimal Bayesian experimental design for nonlinear systems
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• Deep Learning of Vortex Induced Vibrations
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• Wide Activation for Efficient and Accurate Image Super-Resolution
• Physics-informed deep learning for incompressible laminar flows
• Data Driven Governing Equations Approximation Using Deep Neural Networks
• Residual Gated Graph ConvNets
• Non-invasive Inference of Thrombus Material Properties with Physics-informed Neural Networks
• Transformers for Modeling Physical Systems
• Sparse Dynamics for Partial Differential Equations
• Neural Operator: Graph Kernel Network for Partial Differential Equations
• The Neural Particle Method -- An Updated Lagrangian Physics Informed Neural Network for Computational Fluid Dynamics
• A physics-informed operator regression framework for extracting data-driven continuum models
• A Physics-Constrained Data-Driven Approach Based on Locally Convex Reconstruction for Noisy Database
• The effect of prior probabilities on quantification and propagation of imprecise probabilities resulting from small datasets
• Variational system identification of the partial differential equations governing microstructure evolution in materials: Inference over sparse and spatially unrelated data
• Approximating the solution to wave propagation using deep neural networks
• Hard Encoding of Physics for Learning Spatiotemporal Dynamics

Cited by in corpus (23)

• CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Method
• Deep Learning in Deterministic Computational Mechanics
• Physics-informed PointNet: A deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
• KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physics
• Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics
• Accelerating hydrodynamic simulations of urban drainage systems with physics-guided machine learning
• An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator
• RBF-MGN:Solving spatiotemporal PDEs with Physics-informed Graph Neural Network
• CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations
• Physics-informed MeshGraphNets (PI-MGNs): Neural finite element solvers for non-stationary and nonlinear simulations on arbitrary meshes
• A Spectral-based Physics-informed Finite Operator Learning for Prediction of Mechanical Behavior of Microstructures
• Adapting Physics-Informed Neural Networks to Improve ODE Optimization in Mosquito Population Dynamics
• Time series forecasting of multiphase microstructure evolution using deep learning
• On the locality of local neural operator in learning fluid dynamics
• Geometry-aware framework for deep energy method: an application to structural mechanics with hyperelastic materials
• LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry
• Godunov Loss Functions for Modelling of Hyperbolic Conservation Laws
• Spectral Informed Neural Network: An Efficient and Low-Memory PINN
• Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flows
• Multi-resolution Physics-Aware Recurrent Convolutional Neural Network for Complex Flows
• A physics-aware deep learning model for shear band formation around collapsing pores in shocked reactive materials
• Physics-informed Shadowgraph Network: An End-to-end Density Field Reconstruction Method
• SlotPi: Physics-informed Object-centric Reasoning Models