A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Abstract

A physics informed neural network (PINN) incorporates the physics of a system by satisfying its boundary value problem through a neural network's loss function. The PINN approach has shown great success in approximating the map between the solution of a partial differential equation (PDE) and its spatio-temporal input. However, for strongly non-linear and higher order partial differential equations PINN's accuracy reduces significantly. To resolve this problem, we propose a novel PINN scheme that solves the PDE sequentially over successive time segments using a single neural network. The key idea is to re-train the same neural network for solving the PDE over successive time segments while satisfying the already obtained solution for all previous time segments. Thus it is named as backward compatible PINN (bc-PINN). To illustrate the advantages of bc-PINN, we have used the Cahn Hilliard and Allen Cahn equations, which are widely used to describe phase separation and reaction diffusion systems. Our results show significant improvement in accuracy over the PINN method while using a smaller number of collocation points. Additionally, we have shown that using the phase space technique for a higher order PDE could further improve the accuracy and efficiency of the bc-PINN scheme.

References in corpus (21)

• Adam: A Method for Stochastic Optimization
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Fourier Neural Operator for Parametric Partial Differential Equations
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transport
• Inferring solutions of differential equations using noisy multi-fidelity data
• Effective Cahn-Hilliard equation for the phase separation of active Brownian particles
• Towards a 'Thermodynamics' of Active Matter
• Solving parametric PDE problems with artificial neural networks
• Simulator-free Solution of High-Dimensional Stochastic Elliptic Partial Differential Equations using Deep Neural Networks
• Thermodynamic Stability of Driven Open Systems and Control of Phase Separation by Electro-autocatalysis
• Distributed physics informed neural network for data-efficient solution to partial differential equations
• Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
• Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations

Cited by in corpus (33)

• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Residual-based attention in physics-informed neural networks
• Multi-Objective Loss Balancing for Physics-Informed Deep Learning
• Deep Learning in Deterministic Computational Mechanics
• A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositions
• Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domains
• Pre-training strategy for solving evolution equations based on physics-informed neural networks
• Optimizing a DIscrete Loss (ODIL) to solve forward and inverse problems for partial differential equations using machine learning tools
• Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networks
• DCEM: A deep complementary energy method for solid mechanics
• Bayesian Physics Informed Neural Networks for Data Assimilation and Spatio-Temporal Modelling of Wildfires
• A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domains
• Learning Specialized Activation Functions for Physics-informed Neural Networks
• A Framework Based on Symbolic Regression Coupled with eXtended Physics-Informed Neural Networks for Gray-Box Learning of Equations of Motion from Data
• GAS: A Gaussian Mixture Distribution-Based Adaptive Sampling Method for PINNs
• Improved Training of Physics-Informed Neural Networks with Model Ensembles
• CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations
• Self-adaptive weights based on balanced residual decay rate for physics-informed neural networks and deep operator networks
• Learning thermoacoustic interactions in combustors using a physics-informed neural network
• Adapting Physics-Informed Neural Networks to Improve ODE Optimization in Mosquito Population Dynamics
• An extrapolation-driven network architecture for physics-informed deep learning
• An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Study
• A multifidelity approach to continual learning for physical systems
• Machine Learning in Acoustics: A Review and Open-Source Repository
• LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry
• Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities
• Are Two Hidden Layers Still Enough for the Physics-Informed Neural Networks?
• Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation
• Solving 2-D Helmholtz equation in the rectangular, circular, and elliptical domains using neural networks
• Sequential learning based PINNs to overcome temporal domain complexities in unsteady flow past flapping wings
• About optimal loss function for training physics-informed neural networks under respecting causality
• Gradient Flow Based Phase-Field Modeling Using Separable Neural Networks
• Machine learning based prediction of the electronic structure of quasi-one-dimensional materials under strain