Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems

Abstract

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where deep learning algorithms are used to solve problems in mathematics. The latter has popularised the field of scientific machine learning where deep learning is applied to problems in scientific computing. Specifically, more and more neural network architectures have been developed to solve specific classes of partial differential equations (PDEs). Such methods exploit properties that are inherent to PDEs and thus solve the PDEs better than standard feed-forward neural networks, recurrent neural networks, or convolutional neural networks. This has had a great impact in the area of mathematical modeling where parametric PDEs are widely used to model most natural and physical processes arising in science and engineering. In this work, we review such methods as well as their extensions for parametric studies and for solving the related inverse problems. We equally proceed to show their relevance in some industrial applications.

References in corpus (16)

• Multiwavelet-based Operator Learning for Differential Equations
• Wavelet neural operator: a neural operator for parametric partial differential equations
• A Meshfree Generalized Finite Difference Method for Solution Mining Processes
• Nonlocality and Nonlinearity Implies Universality in Operator Learning
• Expressivity of Deep Neural Networks
• Multiscale DeepONet for Nonlinear Operators in Oscillatory Function Spaces for Building Seismic Wave Responses
• Accelerated replica exchange stochastic gradient Langevin diffusion enhanced Bayesian DeepONet for solving noisy parametric PDEs
• Convergence rate of DeepONets for learning operators arising from advection-diffusion equations
• A weighted first-order formulation for solving anisotropic diffusion equations with deep neural networks
• Enhanced DeepONet for Modeling Partial Differential Operators Considering Multiple Input Functions
• Operator learning with PCA-Net: upper and lower complexity bounds
• Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equations
• Variable-Input Deep Operator Networks
• On the Representation of Solutions to Elliptic PDEs in Barron Spaces
• Proof of the Theory-to-Practice Gap in Deep Learning via Sampling Complexity bounds for Neural Network Approximation Spaces
• Parameter Identification by Deep Learning of a Material Model for Granular Media

Cited by in corpus (4)

• DNN-MG: A Hybrid Neural Network/Finite Element Method with Applications to 3D Simulations of the Navier-Stokes Equations
• Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation
• Preconditioned FEM-based Neural Networks for Solving Incompressible Fluid Flows and Related Inverse Problems
• The learned range test method for the inverse inclusion problem