Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing

Abstract

In financial engineering, prices of financial products are computed approximately many times each trading day with (slightly) different parameters in each calculation. In many financial models such prices can be approximated by means of Monte Carlo (MC) simulations. To obtain a good approximation the MC sample size usually needs to be considerably large resulting in a long computing time to obtain a single approximation. In this paper we introduce a new approximation strategy for parametric approximation problems including the parametric financial pricing problems described above. A central aspect of the approximation strategy proposed in this article is to combine MC algorithms with machine learning techniques to, roughly speaking, learn the random variables (LRV) in MC simulations. In other words, we employ stochastic gradient descent (SGD) optimization methods not to train parameters of standard artificial neural networks (ANNs) but to learn random variables appearing in MC approximations. We numerically test the LRV strategy on various parametric problems with convincing results when compared with standard MC simulations, Quasi-Monte Carlo simulations, SGD-trained shallow ANNs, and SGD-trained deep ANNs. Our numerical simulations strongly indicate that the LRV strategy might be capable to overcome the curse of dimensionality in the $L^{\infty }$-norm in several cases where the standard deep learning approach has been proven not to be able to do so. This is not a contradiction to lower bounds established in the scientific literature because this new LRV strategy is outside of the class of algorithms for which lower bounds have been established in the scientific literature. The proposed LRV strategy is of general nature and not only restricted to the parametric financial pricing problems described above, but applicable to a large class of approximation problems.

arXiv comment71 pages, 4 Figures, 14 Tables; to appear in Math. Finance

References in corpus (30)

• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• DGM: A deep learning algorithm for solving partial differential equations
• An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications
• Solving high-dimensional partial differential equations using deep learning
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• Weak Adversarial Networks for High-dimensional Partial Differential Equations
• Numerical approximations of stochastic differential equations with non-globally Lipschitz continuous coefficients
• Solving parametric PDE problems with artificial neural networks
• Deep learning observables in computational fluid dynamics
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• On multilevel Picard numerical approximations for high-dimensional nonlinear parabolic partial differential equations and high-dimensional nonlinear backward stochastic differential equations
• Deep splitting method for parabolic PDEs
• An overview on deep learning-based approximation methods for partial differential equations
• Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion Monte Carlo like approach
• Solving the Kolmogorov PDE by means of deep learning
• Pricing and hedging American-style options with deep learning
• Multilevel Picard iterations for solving smooth semilinear parabolic heat equations
• Solving high-dimensional optimal stopping problems using deep learning
• A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks
• Overcoming the curse of dimensionality in the approximative pricing of financial derivatives with default risks
• Full error analysis for the training of deep neural networks
• RNA Secondary Structure Prediction By Learning Unrolled Algorithms
• On nonlinear Feynman-Kac formulas for viscosity solutions of semilinear parabolic partial differential equations
• Uniform error estimates for artificial neural network approximations for heat equations
• Learning Deep Stochastic Optimal Control Policies using Forward-Backward SDEs
• Deep Fictitious Play for Finding Markovian Nash Equilibrium in Multi-Agent Games
• Derivative-Informed Projected Neural Networks for High-Dimensional Parametric Maps Governed by PDEs
• Solving Elliptic Equations with Brownian Motion: Bias Reduction and Temporal Difference Learning

Cited by in corpus (2)

• An overview on deep learning-based approximation methods for partial differential equations
• Deep Operator BSDE: a Numerical Scheme to Approximate Solution Operators