Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations

Abstract

One of the most challenging issues in applied mathematics is to develop and analyze algorithms which are able to approximately compute solutions of high-dimensional nonlinear partial differential equations (PDEs). In particular, it is very hard to develop approximation algorithms which do not suffer under the curse of dimensionality in the sense that the number of computational operations needed by the algorithm to compute an approximation of accuracy $\epsilon >0$ grows at most polynomially in both the reciprocal $1/\epsilon$ of the required accuracy and the dimension $d\in \mathbb{N}$ of the PDE. Recently, a new approximation method, the so-called full history recursive multilevel Picard (MLP) approximation method, has been introduced and, until today, this approximation scheme is the only approximation method in the scientific literature which has been proven to overcome the curse of dimensionality in the numerical approximation of semilinear PDEs with general time horizons. It is a key contribution of this article to extend the MLP approximation method to systems of semilinear PDEs and to numerically test it on several example PDEs. More specifically, we apply the proposed MLP approximation method in the case of Allen-Cahn PDEs, Sine-Gordon-type PDEs, systems of coupled semilinear heat PDEs, and semilinear Black-Scholes PDEs in up to 1000 dimensions. The presented numerical simulation results suggest in the case of each of these example PDEs that the proposed MLP approximation method produces very accurate results in short runtimes and, in particular, the presented numerical simulation results indicate that the proposed MLP approximation scheme significantly outperforms certain deep learning based approximation methods for high-dimensional semilinear PDEs.

arXiv comment21 pages

References in corpus (30)

• DGM: A deep learning algorithm for solving partial differential equations
• Solving high-dimensional partial differential equations using deep learning
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations
• PDE-Net: Learning PDEs from Data
• Deep learning observables in computational fluid dynamics
• A proof that artificial neural networks overcome the curse of dimensionality in the numerical approximation of Black-Scholes partial differential equations
• Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equations
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• On multilevel Picard numerical approximations for high-dimensional nonlinear parabolic partial differential equations and high-dimensional nonlinear backward stochastic differential equations
• Deep splitting method for parabolic PDEs
• A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations
• DNN Expression Rate Analysis of High-dimensional PDEs: Application to Option Pricing
• The dynamical sine-Gordon model
• Pricing and hedging American-style options with deep learning
• Multilevel Picard iterations for solving smooth semilinear parabolic heat equations
• Overcoming the curse of dimensionality in the approximative pricing of financial derivatives with default risks
• Overcoming the curse of dimensionality in the numerical approximation of Allen-Cahn partial differential equations via truncated full-history recursive multilevel Picard approximations
• Neural Networks Trained to Solve Differential Equations Learn General Representations
• Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations
• A Discussion on Solving Partial Differential Equations using Neural Networks
• Rectified deep neural networks overcome the curse of dimensionality for nonsmooth value functions in zero-sum games of nonlinear stiff systems
• Uniform error estimates for artificial neural network approximations for heat equations
• Overcoming the curse of dimensionality in the numerical approximation of high-dimensional semilinear elliptic partial differential equations
• Deep Neural Network Framework Based on Backward Stochastic Differential Equations for Pricing and Hedging American Options in High Dimensions
• Generalised multilevel Picard approximations
• Multi-level Picard approximations of high-dimensional semilinear parabolic differential equations with gradient-dependent nonlinearities
• Space-time error estimates for deep neural network approximations for differential equations

Cited by in corpus (14)

• Tackling the Curse of Dimensionality with Physics-Informed Neural Networks
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Deep splitting method for parabolic PDEs
• An overview on deep learning-based approximation methods for partial differential equations
• Overcoming the curse of dimensionality in the numerical approximation of semilinear parabolic partial differential equations
• Overcoming the curse of dimensionality in the numerical approximation of Allen-Cahn partial differential equations via truncated full-history recursive multilevel Picard approximations
• Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networks
• Overcoming the curse of dimensionality in the numerical approximation of parabolic partial differential equations with gradient-dependent nonlinearities
• Solving non-linear Kolmogorov equations in large dimensions by using deep learning: a numerical comparison of discretization schemes
• Multilevel Picard approximations for high-dimensional semilinear second-order PDEs with Lipschitz nonlinearities
• Deep learning algorithms for solving high dimensional nonlinear backward stochastic differential equations
• Full history recursive multilevel Picard approximations for ordinary differential equations with expectations
• A Machine-Learning Method for Time-Dependent Wave Equations over Unbounded Domains
• Strong $L^p$-error analysis of nonlinear Monte Carlo approximations for high-dimensional semilinear partial differential equations