Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

Abstract

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for solving forward and inverse problems associated with partial differential equations, we circumvent the tyranny of numerical discretization by devising an algorithm that is scalable to high-dimensions. In particular, we approximate the unknown solution by a deep neural network which essentially enables us to benefit from the merits of automatic differentiation. To train the aforementioned neural network we leverage the well-known connection between high-dimensional partial differential equations and forward-backward stochastic differential equations. In fact, independent realizations of a standard Brownian motion will act as training data. We test the effectiveness of our approach for a couple of benchmark problems spanning a number of scientific domains including Black-Scholes-Barenblatt and Hamilton-Jacobi-Bellman equations, both in 100-dimensions.

Cited by in corpus (14)

• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate
• Tackling the Curse of Dimensionality with Physics-Informed Neural Networks
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• PFNN: A Penalty-Free Neural Network Method for Solving a Class of Second-Order Boundary-Value Problems on Complex Geometries
• Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism
• Stochastic analysis of heterogeneous porous material with modified neural architecture search (NAS) based physics-informed neural networks using transfer learning
• An overview on deep learning-based approximation methods for partial differential equations
• On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
• Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networks
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations
• Deep learning for gradient flows using the Brezis-Ekeland principle