Neural Networks to solve Partial Differential Equations: a Comparison with Finite Elements

Abstract

We compare the Finite Element Method (FEM) simulation of a standard Partial Differential Equation thermal problem of a plate with a hole with a Neural Network (NN) simulation. The largest deviation from the true solution obtained from FEM ($0.015$ for a solution on the order of unity) is easily achieved with NN too without much tuning of the hyperparameters. Accuracies below $0.01$ instead require refinement with an alternative optimizer to reach a similar performance with NN. A rough comparison between the Floating Point Operations values, as a machine-independent quantification of the computational performance, suggests a significant difference between FEM and NN in favour of the former. This also strongly holds for computation time: for an accuracy on the order of $10^{-5}$, FEM and NN require $54$ and $1100$ seconds, respectively. A detailed analysis of the effect of varying different hyperparameters shows that accuracy and computational time only weakly depend on the major part of them. Accuracies below $0.01$ cannot be achieved with the "adam'' optimizers and it looks as though accuracies below $10^{-5}$ cannot be achieved at all. In conclusion, the present work shows that for the concrete case of solving a steady-state 2D heat equation, the performance of a FEM algorithm is significantly better than the solution via networks.

References in corpus (9)

• Scikit-learn: Machine Learning in Python
• DGM: A deep learning algorithm for solving partial differential equations
• An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications
• Solving high-dimensional partial differential equations using deep learning
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations
• IDRLnet: A Physics-Informed Neural Network Library

Cited by in corpus (1)

• Optimizing Variational Physics-Informed Neural Networks Using Least Squares