Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks

Abstract

In recent years, deep learning technology has been used to solve partial differential equations (PDEs), among which the physics-informed neural networks (PINNs) emerges to be a promising method for solving both forward and inverse PDE problems. PDEs with a point source that is expressed as a Dirac delta function in the governing equations are mathematical models of many physical processes. However, they cannot be solved directly by conventional PINNs method due to the singularity brought by the Dirac delta function. We propose a universal solution to tackle this problem with three novel techniques. Firstly the Dirac delta function is modeled as a continuous probability density function to eliminate the singularity; secondly a lower bound constrained uncertainty weighting algorithm is proposed to balance the PINNs losses between point source area and other areas; and thirdly a multi-scale deep neural network with periodic activation function is used to improve the accuracy and convergence speed of the PINNs method. We evaluate the proposed method with three representative PDEs, and the experimental results show that our method outperforms existing deep learning-based methods with respect to the accuracy, the efficiency and the versatility.

References in corpus (11)

• DGM: A deep learning algorithm for solving partial differential equations
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Fourier Neural Operator for Parametric Partial Differential Equations
• Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flows
• Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
• Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains
• On the Spectral Bias of Neural Networks
• When and why PINNs fail to train: A neural tangent kernel perspective
• Solving the wave equation with physics-informed deep learning
• NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework
• Physics-informed deep learning for flow and deformation in poroelastic media