Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equations

Abstract

The development of new classification and regression algorithms based on empirical risk minimization (ERM) over deep neural network hypothesis classes, coined deep learning, revolutionized the area of artificial intelligence, machine learning, and data analysis. In particular, these methods have been applied to the numerical solution of high-dimensional partial differential equations with great success. Recent simulations indicate that deep learning-based algorithms are capable of overcoming the curse of dimensionality for the numerical solution of Kolmogorov equations, which are widely used in models from engineering, finance, and the natural sciences. The present paper considers under which conditions ERM over a deep neural network hypothesis class approximates the solution of a $d$-dimensional Kolmogorov equation with affine drift and diffusion coefficients and typical initial values arising from problems in computational finance up to error $\epsilon$. We establish that, with high probability over draws of training samples, such an approximation can be achieved with both the size of the hypothesis class and the number of training samples scaling only polynomially in $d$ and ${\epsilon }^{-1}$. It can be concluded that ERM over deep neural network hypothesis classes overcomes the curse of dimensionality for the numerical solution of linear Kolmogorov equations with affine coefficients.

References in corpus (8)

• DGM: A deep learning algorithm for solving partial differential equations
• Solving high-dimensional partial differential equations using deep learning
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• A Mean Field View of the Landscape of Two-Layers Neural Networks
• Local Rademacher complexities
• Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations
• Provable approximation properties for deep neural networks
• Loss of regularity for Kolmogorov equations

Cited by in corpus (22)

• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• Deep splitting method for parabolic PDEs
• DNN Expression Rate Analysis of High-dimensional PDEs: Application to Option Pricing
• Physics and Equality Constrained Artificial Neural Networks: Application to Forward and Inverse Problems with Multi-fidelity Data Fusion
• Solving the Kolmogorov PDE by means of deep learning
• Deep Network with Approximation Error Being Reciprocal of Width to Power of Square Root of Depth
• Full error analysis for the training of deep neural networks
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Numerical methods for backward stochastic differential equations: A survey
• Uniform error estimates for artificial neural network approximations for heat equations
• Overcoming the curse of dimensionality in the numerical approximation of parabolic partial differential equations with gradient-dependent nonlinearities
• A new efficient approximation scheme for solving high-dimensional semilinear PDEs: control variate method for Deep BSDE solver
• Exponential ReLU Neural Network Approximation Rates for Point and Edge Singularities
• Imaging Conductivity from Current Density Magnitude using Neural Networks
• Deep neural network approximations for Monte Carlo algorithms
• Towards fast weak adversarial training to solve high dimensional parabolic partial differential equations using XNODE-WAN
• Towards a regularity theory for ReLU networks -- chain rule and global error estimates
• Unbiased deep solvers for linear parametric PDEs
• Asymptotic Consistency for Nonconvex Risk-Averse Stochastic Optimization with Infinite Dimensional Decision Spaces
• Turbulence closure modeling with data-driven techniques: Investigation of generalizable deep neural networks
• Strong overall error analysis for the training of artificial neural networks via random initializations