CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations

Abstract

Despite the growing popularity of physics-informed neural networks (PINNs), their applicability in the long-time integration of partial differential equations (PDEs) remains constrained. We argue that this problem stems from the lack of consideration of temporal causality in the original PINN formulation, resulting in a bias towards satisfying governing equations at later times before learning the initial condition and hence leading to erroneous solutions. To this end, we propose a novel method that seamlessly integrates temporal causality into the training process. Drawing inspiration from classical numerical methods where the temporal causality is reflected, we divide the time domain into nonoverlapping subintervals, assign a unique neural network to each subinterval, and construct a loss function founded on the integral form of PDEs within these subintervals. The proposed networks undergo sequential training, beginning with the initial time step. Our method demonstrates significant improvement in accuracy for long-time simulations of various PDE problems where the original PINN method fails while it requires less computational cost and memory compared to the PINN method. A parallelization algorithm is provided to further enhance the computational efficiency, showing a significant speedup for solving time-dependent PDEs.

26 pages, 4 tables, 15 figures

References in corpus (20)

• Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEs
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networks
• Simulator-free Solution of High-Dimensional Stochastic Elliptic Partial Differential Equations using Deep Neural Networks
• Physics-Informed Neural Operator for Learning Partial Differential Equations
• Evolutional Deep Neural Network
• A cusp-capturing PINN for elliptic interface problems
• PI-VAE: Physics-Informed Variational Auto-Encoder for stochastic differential equations
• Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow models
• PCNN: A physics-constrained neural network for multiphase flows
• Neural-PDE: A RNN based neural network for solving time dependent PDEs