Deep splitting method for parabolic PDEs

Abstract

In this paper we introduce a numerical method for nonlinear parabolic PDEs that combines operator splitting with deep learning. It divides the PDE approximation problem into a sequence of separate learning problems. Since the computational graph for each of the subproblems is comparatively small, the approach can handle extremely high-dimensional PDEs. We test the method on different examples from physics, stochastic control and mathematical finance. In all cases, it yields very good results in up to 10,000 dimensions with short run times.

25 pages

References in corpus (12)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• A regression-based Monte Carlo method to solve backward stochastic differential equations
• Deep learning observables in computational fluid dynamics
• Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equations
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• An overview on deep learning-based approximation methods for partial differential equations
• Stratified regression Monte-Carlo scheme for semilinear PDEs and BSDEs with large scale parallelization on GPUs
• Overcoming the curse of dimensionality in the approximative pricing of financial derivatives with default risks
• A proof that deep artificial neural networks overcome the curse of dimensionality in the numerical approximation of Kolmogorov partial differential equations with constant diffusion and nonlinear drift coefficients
• Runge-Kutta schemes for backward stochastic differential equations
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Numerical simulation of BSDEs using empirical regression methods: theory and practice

Cited by in corpus (32)

• Tackling the Curse of Dimensionality with Physics-Informed Neural Networks
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• An overview on deep learning-based approximation methods for partial differential equations
• On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
• SelectNet: Self-paced Learning for High-dimensional Partial Differential Equations
• Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems
• A neural network multigrid solver for the Navier-Stokes equations
• Overcoming the curse of dimensionality in the numerical approximation of Allen-Cahn partial differential equations via truncated full-history recursive multilevel Picard approximations
• Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networks
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Numerical methods for backward stochastic differential equations: A survey
• Uniform error estimates for artificial neural network approximations for heat equations
• Overcoming the curse of dimensionality in the numerical approximation of high-dimensional semilinear elliptic partial differential equations
• Neural networks-based algorithms for stochastic control and PDEs in finance
• Deep neural network approximations for Monte Carlo algorithms
• Solving non-linear Kolmogorov equations in large dimensions by using deep learning: a numerical comparison of discretization schemes
• Generalised multilevel Picard approximations
• Convergence of Deep Fictitious Play for Stochastic Differential Games
• Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing
• Multilevel Picard approximations for high-dimensional semilinear second-order PDEs with Lipschitz nonlinearities
• Deep learning based numerical approximation algorithms for stochastic partial differential equations
• Deep learning algorithms for solving high dimensional nonlinear backward stochastic differential equations
• Computing non-equilibrium trajectories by a deep learning approach
• Splitting physics-informed neural networks for inferring the dynamics of integer- and fractional-order neuron models
• Solving high-dimensional parabolic PDEs using the tensor train format
• Solving PDEs on Unknown Manifolds with Machine Learning
• Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures
• Solving path dependent PDEs with LSTM networks and path signatures
• Neural Network Approximation of Optimal Controls for Stochastic Reaction-Diffusion Equations
• An energy-based deep splitting method for the nonlinear filtering problem
• Deep Learning for Constrained Utility Maximisation
• XNet-Enhanced Deep BSDE Method and Numerical Analysis