A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiency

Abstract

Physics-informed neural networks (PINNs) have been widely applied in different fields due to their effectiveness in solving partial differential equations (PDEs). However, the accuracy and efficiency of PINNs need to be considerably improved for scientific and commercial use. To address this issue, we systematically propose a novel dimension-augmented physics-informed neural network (DaPINN), which simultaneously and significantly improves the accuracy and efficiency of the PINN. In the DaPINN model, we introduce inductive bias in the neural network to enhance network generalizability by adding a special regularization term to the loss function. Furthermore, we manipulate the network input dimension by inserting additional sample features and incorporating the expanded dimensionality in the loss function. Moreover, we verify the effectiveness of power series augmentation, Fourier series augmentation and replica augmentation, in both forward and backward problems. In most experiments, the error of DaPINN is 1$\sim$2 orders of magnitude lower than that of PINN. The results show that the DaPINN outperforms the original PINN in terms of both accuracy and efficiency with a reduced dependence on the number of sample points. We also discuss the complexity of the DaPINN and its compatibility with other methods.

arXiv comment33 pages, 12 figures

References in corpus (12)

• DeepXDE: A deep learning library for solving differential equations
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• DGM: A deep learning algorithm for solving partial differential equations
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations
• Physics-informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
• Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transport
• A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networks
• An adaptive octree finite element method for PDEs posed on surfaces

Cited by in corpus (2)

• Residual-based attention in physics-informed neural networks
• Learning in PINNs: Phase transition, diffusion equilibrium, and generalization