Least-Squares Neural Network (LSNN) Method For Linear Advection-Reaction Equation: Discontinuity Interface

Abstract

We studied the least-squares ReLU neural network (LSNN) method for solving linear advection-reaction equation with discontinuous solution in [Cai, Zhiqiang, Jingshuang Chen, and Min Liu. ``Least-squares ReLU neural network (LSNN) method for linear advection-reaction equation.'' Journal of Computational Physics 443 (2021), 110514]. The method is based on a least-squares formulation and uses a new class of approximating functions: ReLU neural network (NN) functions. A critical and additional component of the LSNN method, differing from other NN-based methods, is the introduction of a properly designed and physics preserved discrete differential operator. In this paper, we study the LSNN method for problems with discontinuity interfaces. First, we show that ReLU NN functions with depth $\lceil {\log }_2(d+1)\rceil +1$ can approximate any $d$-dimensional step function on a discontinuity interface generated by a vector field as streamlines with any prescribed accuracy. By decomposing the solution into continuous and discontinuous parts, we prove theoretically that discretization error of the LSNN method using ReLU NN functions with depth $\lceil {\log }_2(d+1)\rceil +1$ is mainly determined by the continuous part of the solution provided that the solution jump is constant. Numerical results for both two- and three-dimensional test problems with various discontinuity interfaces show that the LSNN method with enough layers is accurate and does not exhibit the common Gibbs phenomena along discontinuity interfaces.

30 pages

References in corpus (9)

• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• DGM: A deep learning algorithm for solving partial differential equations
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Learning data driven discretizations for partial differential equations
• Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs
• Deep Network Approximation Characterized by Number of Neurons
• Least-Squares ReLU Neural Network (LSNN) Method For Linear Advection-Reaction Equation
• Deep Ritz Method with Adaptive Quadrature for Linear Elasticity
• Self-adaptive deep neural network: Numerical approximation to functions and PDEs

Cited by in corpus (2)

• An approximate Riemann solver approach in Physics-Informed Neural Networks for hyperbolic conservation laws
• Least-Squares Neural Network (LSNN) Method For Linear Advection-Reaction Equation: Non-constant Jumps