Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning

Abstract

In recent years, tremendous progress has been made on numerical algorithms for solving partial differential equations (PDEs) in a very high dimension, using ideas from either nonlinear (multilevel) Monte Carlo or deep learning. They are potentially free of the curse of dimensionality for many different applications and have been proven to be so in the case of some nonlinear Monte Carlo methods for nonlinear parabolic PDEs. In this paper, we review these numerical and theoretical advances. In addition to algorithms based on stochastic reformulations of the original problem, such as the multilevel Picard iteration and the Deep BSDE method, we also discuss algorithms based on the more traditional Ritz, Galerkin, and least square formulations. We hope to demonstrate to the reader that studying PDEs as well as control and variational problems in very high dimensions might very well be among the most promising new directions in mathematics and scientific computing in the near future.

References in corpus (14)

• A regression-based Monte Carlo method to solve backward stochastic differential equations
• Deep Learning Approximation for Stochastic Control Problems
• Stratified regression Monte-Carlo scheme for semilinear PDEs and BSDEs with large scale parallelization on GPUs
• Overcoming the curse of dimensionality in the numerical approximation of high-dimensional semilinear elliptic partial differential equations
• Numerical simulation of BSDEs using empirical regression methods: theory and practice
• Variations on branching methods for non linear PDEs
• Generalised multilevel Picard approximations
• Convergence of Deep Fictitious Play for Stochastic Differential Games
• Multilevel Picard approximations for high-dimensional semilinear second-order PDEs with Lipschitz nonlinearities
• Solving Inverse Wave Scattering with Deep Learning
• Deep Ritz revisited
• Optimal Policies for a Pandemic: A Stochastic Game Approach and a Deep Learning Algorithm
• Neural ODE control for classification, approximation and transport
• FBSDE based Neural Network Algorithms for High-Dimensional Quasilinear Parabolic PDEs

Cited by in corpus (28)

• An overview on deep learning-based approximation methods for partial differential equations
• Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networks
• Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems
• Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• Numerical methods for backward stochastic differential equations: A survey
• MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs
• Deep learning probability flows and entropy production rates in active matter
• Data-driven Identification of 2D Partial Differential Equations using extracted physical features
• Multiscale simulations for multi-continuum Richards equations
• Machine learning based data-driven discovery of nonlinear phase-field dynamics
• Solving non-linear Kolmogorov equations in large dimensions by using deep learning: a numerical comparison of discretization schemes
• Imaging Conductivity from Current Density Magnitude using Neural Networks
• SVD-PINNs: Transfer Learning of Physics-Informed Neural Networks via Singular Value Decomposition
• A model-data asymptotic-preserving neural network method based on micro-macro decomposition for gray radiative transfer equations
• Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing
• Deep neural network approximations for the stable manifolds of the Hamilton-Jacobi-Bellman equations
• Deep learning based numerical approximation algorithms for stochastic partial differential equations
• Learning Density Distribution of Reachable States for Autonomous Systems
• A Matrix Product State Model for Simultaneous Classification and Generation
• A Deep Learning Approach for Predicting Spatiotemporal Dynamics From Sparsely Observed Data
• Solving path dependent PDEs with LSTM networks and path signatures
• Data-informed Deep Optimization
• Full history recursive multilevel Picard approximations for ordinary differential equations with expectations
• Adaptive feature capture method for solving partial differential equations with near singular solutions
• A learning scheme by sparse grids and Picard approximations for semilinear parabolic PDEs
• Statistics for stochastic differential equations and approximations of resolvent
• Risk-indifference Pricing of American-style Contingent Claims
• Deep Semi-Martingale Optimal Transport