A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations

Abstract

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for these problems based on a deep learning approach. Specifically, the random PDE is approximated by a feed-forward fully-connected deep residual network, with either strong or weak enforcement of initial and boundary constraints. The framework is mesh-free, and can handle irregular computational domains. Parameters of the approximating deep neural network are determined iteratively using variants of the Stochastic Gradient Descent (SGD) algorithm. The satisfactory accuracy of the proposed frameworks is numerically demonstrated on diffusion and heat conduction problems, in comparison with the converged Monte Carlo-based finite element results.

References in corpus (3)

• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• A non-adapted sparse approximation of PDEs with stochastic inputs

Cited by in corpus (24)

• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate
• Weak Adversarial Networks for High-dimensional Partial Differential Equations
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• Efficient training of physics-informed neural networks via importance sampling
• Simulator-free Solution of High-Dimensional Stochastic Elliptic Partial Differential Equations using Deep Neural Networks
• Physics-Driven Regularization of Deep Neural Networks for Enhanced Engineering Design and Analysis
• A proof that rectified deep neural networks overcome the curse of dimensionality in the numerical approximation of semilinear heat equations
• Pre-training strategy for solving evolution equations based on physics-informed neural networks
• PI-VAE: Physics-Informed Variational Auto-Encoder for stochastic differential equations
• A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
• Quantum Quantile Mechanics: Solving Stochastic Differential Equations for Generating Time-Series
• Comparison of Neural FEM and Neural Operator Methods for applications in Solid Mechanics
• Neural Networks to solve Partial Differential Equations: a Comparison with Finite Elements
• Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
• LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry
• Solving Elliptic Equations with Brownian Motion: Bias Reduction and Temporal Difference Learning
• Neural Network Solutions to Differential Equations in Non-Convex Domains: Solving the Electric Field in the Slit-Well Microfluidic Device
• Physics-informed neural networks for solving functional renormalization group on a lattice
• Studying First Passage Problems using Neural Networks: A Case Study in the Slit-Well Microfluidic Device