PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEs

Abstract

Physics-informed neural networks (PINNs) encode physical conservation laws and prior physical knowledge into the neural networks, ensuring the correct physics is represented accurately while alleviating the need for supervised learning to a great degree. While effective for relatively short-term time integration, when long time integration of the time-dependent PDEs is sought, the time-space domain may become arbitrarily large and hence training of the neural network may become prohibitively expensive. To this end, we develop a parareal physics-informed neural network (PPINN), hence decomposing a long-time problem into many independent short-time problems supervised by an inexpensive/fast coarse-grained (CG) solver. In particular, the serial CG solver is designed to provide approximate predictions of the solution at discrete times, while initiate many fine PINNs simultaneously to correct the solution iteratively. There is a two-fold benefit from training PINNs with small-data sets rather than working on a large-data set directly, i.e., training of individual PINNs with small-data is much faster, while training the fine PINNs can be readily parallelized. Consequently, compared to the original PINN approach, the proposed PPINN approach may achieve a significant speedup for long-time integration of PDEs, assuming that the CG solver is fast and can provide reasonable predictions of the solution, hence aiding the PPINN solution to converge in just a few iterations. To investigate the PPINN performance on solving time-dependent PDEs, we first apply the PPINN to solve the Burgers equation, and subsequently we apply the PPINN to solve a two-dimensional nonlinear diffusion-reaction equation. Our results demonstrate that PPINNs converge in a couple of iterations with significant speed-ups proportional to the number of time-subdomains employed.

17 pages, 7 figures, 5 tables

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• DeepXDE: A deep learning library for solving differential equations
• fPINNs: Fractional Physics-Informed Neural Networks
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• On the Computational Efficiency of Training Neural Networks
• Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations
• Physical Symmetries Embedded in Neural Networks
• Parareal in time 3D numerical solver for the LWR Benchmark neutron diffusion transient model
• Physics-Informed Echo State Networks for Chaotic Systems Forecasting
• Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks
• Solving Irregular and Data-enriched Differential Equations using Deep Neural Networks
• Enforcing constraints for time series prediction in supervised, unsupervised and reinforcement learning
• Supervised parallel-in-time algorithm for long-time Lagrangian simulations of stochastic dynamics: Application to hydrodynamics

Cited by in corpus (69)

• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisons
• Stiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics
• Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
• Simulation of multi-species flow and heat transfer using physics-informed neural networks
• Multi-Objective Loss Balancing for Physics-Informed Deep Learning
• Deep Learning in Deterministic Computational Mechanics
• Physics-informed PointNet: A deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
• Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology
• A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic
• A nonlocal physics-informed deep learning framework using the peridynamic differential operator
• Physics-informed neural networks for the shallow-water equations on the sphere
• Physics-Informed Neural Nets for Control of Dynamical Systems
• Deep learning of free boundary and Stefan problems
• Physics-informed neural networks of the Saint-Venant equations for downscaling a large-scale river model
• A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositions
• A novel meta-learning initialization method for physics-informed neural networks
• Explore missing flow dynamics by physics-informed deep learning: the parameterised governing systems
• Multifidelity Modeling for Physics-Informed Neural Networks (PINNs)
• On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
• Evolutional Deep Neural Network
• Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
• DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimization
• Mosaic Flows: A Transferable Deep Learning Framework for Solving PDEs on Unseen Domains
• A solver for subsonic flow around airfoils based on physics-informed neural networks and mesh transformation
• Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networks
• Recipes for when Physics Fails: Recovering Robust Learning of Physics Informed Neural Networks
• An extended physics informed neural network for preliminary analysis of parametric optimal control problems
• Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations
• Physics-informed neural networks for predicting gas flow dynamics and unknown parameters in diesel engines
• Learning elliptic partial differential equations with randomized linear algebra
• Parsimonious Physics-Informed Random Projection Neural Networks for Initial-Value Problems of ODEs and index-1 DAEs
• Deep neural network enabled corrective source term approach to hybrid analysis and modeling
• BubbleNet: Inferring micro-bubble dynamics with semi-physics-informed deep learning
• Learning Stochastic Dynamics with Statistics-Informed Neural Network
• CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations
• A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
• Physics-informed neural networks for unsteady incompressible flows with time-dependent moving boundaries
• PCNN: A physics-constrained neural network for multiphase flows
• Neural network architectures using min-plus algebra for solving certain high dimensional optimal control problems and Hamilton-Jacobi PDEs
• Learning thermoacoustic interactions in combustors using a physics-informed neural network
• Learning characteristic parameters and dynamics of centrifugal pumps under multiphase flow using physics-informed neural networks
• Machines Learn to Infer Stellar Parameters Just by Looking at a Large Number of Spectra
• Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
• Deep learning for solution and inversion of structural mechanics and vibrations
• Bayesian neural networks for weak solution of PDEs with uncertainty quantification
• Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learnings
• A multifidelity approach to continual learning for physical systems
• Modelling parametric uncertainty in PDEs models via Physics-Informed Neural Networks
• Parareal with a physics-informed neural network as coarse propagator
• A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs
• Scientific machine learning in Hydrology: a unified perspective
• Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures
• Performance Comparison for Scientific Computations on the Edge via Relative Performance
• Distributed Machine Learning for Computational Engineering using MPI
• Quantum Extremal Learning
• A Deep Learning Based Discontinuous Galerkin Method for Hyperbolic Equations with Discontinuous Solutions and Random Uncertainties
• Modified physics-informed neural network method based on the conservation law constraint and its prediction of optical solitons
• Discontinuity-aware KAN-based physics-informed neural networks
• Hammering at the entropy: A GENERIC-guided approach to learning polymeric rheological constitutive equations using PINNs
• Space-time parallel scaling of Parareal with a physics-informed Fourier Neural Operator coarse propagator applied to the Black-Scholes equation
• Theory-training deep neural networks for an alloy solidification benchmark problem
• Neural semi-Lagrangian method for high-dimensional advection-diffusion problems
• Differentiable Multiple Shooting Layers
• Physics-informed Neural-Network Software for Molecular Dynamics Applications
• Application of Video-to-Video Translation Networks to Computational Fluid Dynamics
• Trust Region Method for Coupled Systems of PDE Solvers and Deep Neural Networks