A Discussion on Solving Partial Differential Equations using Neural Networks

Abstract

Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are five-fold. (1) Numerical experiments show that small neural networks (< 500 learnable parameters) are able to accurately learn complex solutions for systems of partial differential equations. (2) It investigates the influence of random weight initialization on the quality of the neural network approximate solution and demonstrates how one can take advantage of this non-determinism using ensemble learning. (3) It investigates the suitability of the loss function used in this work. (4) It studies the benefits and drawbacks of solving (systems of) PDEs with neural networks compared to classical numerical methods. (5) It proposes an exhaustive list of possible directions of future work.

9 pages, 2 figures

References in corpus (1)

• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations

Cited by in corpus (18)

• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs
• An overview on deep learning-based approximation methods for partial differential equations
• On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networks
• Uniform error estimates for artificial neural network approximations for heat equations
• Overcoming the curse of dimensionality in the numerical approximation of high-dimensional semilinear elliptic partial differential equations
• Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations
• Elvet -- a neural network-based differential equation and variational problem solver
• Generalised multilevel Picard approximations
• A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs
• Multilevel Picard approximations for high-dimensional semilinear second-order PDEs with Lipschitz nonlinearities
• Analytical derivatives of Neural Networks
• Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures
• Discovery of Governing Equations with Recursive Deep Neural Networks
• Deep Neural Network Based Differential Equation Solver for HIV Enzyme Kinetics
• SEMULATOR: Emulating the Dynamics of Crossbar Array-based Analog Neural System with Regression Neural Networks