Deep splitting method for parabolic PDEs

Abstract

In this paper we introduce a numerical method for nonlinear parabolic PDEs that combines operator splitting with deep learning. It divides the PDE approximation problem into a sequence of separate learning problems. Since the computational graph for each of the subproblems is comparatively small, the approach can handle extremely high-dimensional PDEs. We test the method on different examples from physics, stochastic control and mathematical finance. In all cases, it yields very good results in up to 10,000 dimensions with short run times.

25 pages

References in corpus (31)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• DGM: A deep learning algorithm for solving partial differential equations
• Solving high-dimensional partial differential equations using deep learning
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• A regression-based Monte Carlo method to solve backward stochastic differential equations
• Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations
• PDE-Net: Learning PDEs from Data
• Deep learning observables in computational fluid dynamics
• Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equations
• A forward--backward stochastic algorithm for quasi-linear PDEs
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• On multilevel Picard numerical approximations for high-dimensional nonlinear parabolic partial differential equations and high-dimensional nonlinear backward stochastic differential equations
• An overview on deep learning-based approximation methods for partial differential equations
• Solving the Kolmogorov PDE by means of deep learning
• Loss of regularity for Kolmogorov equations
• Multilevel Picard iterations for solving smooth semilinear parabolic heat equations
• Numerical simulation of quadratic BSDEs
• Overcoming the curse of dimensionality in the approximative pricing of financial derivatives with default risks
• Stratified regression Monte-Carlo scheme for semilinear PDEs and BSDEs with large scale parallelization on GPUs
• A proof that deep artificial neural networks overcome the curse of dimensionality in the numerical approximation of Kolmogorov partial differential equations with constant diffusion and nonlinear drift coefficients
• Neural Networks Trained to Solve Differential Equations Learn General Representations
• Approximation of backward stochastic differential equations using Malliavin weights and least-squares regression
• Runge-Kutta schemes for backward stochastic differential equations
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Time discretization of FBSDE with polynomial growth drivers and reaction-diffusion PDEs
• Strong convergence of full-discrete nonlinearity-truncated accelerated exponential Euler-type approximations for stochastic Kuramoto-Sivashinsky equations
• A primal-dual algorithm for BSDEs
• Numerical simulation of BSDEs using empirical regression methods: theory and practice

Cited by in corpus (33)

• Tackling the Curse of Dimensionality with Physics-Informed Neural Networks
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• An overview on deep learning-based approximation methods for partial differential equations
• On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
• SelectNet: Self-paced Learning for High-dimensional Partial Differential Equations
• Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems
• Strong error analysis for stochastic gradient descent optimization algorithms
• A neural network multigrid solver for the Navier-Stokes equations
• Overcoming the curse of dimensionality in the numerical approximation of Allen-Cahn partial differential equations via truncated full-history recursive multilevel Picard approximations
• Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networks
• Numerical simulations for full history recursive multilevel Picard approximations for systems of high-dimensional partial differential equations
• Numerical methods for backward stochastic differential equations: A survey
• Uniform error estimates for artificial neural network approximations for heat equations
• Overcoming the curse of dimensionality in the numerical approximation of high-dimensional semilinear elliptic partial differential equations
• Solving non-linear Kolmogorov equations in large dimensions by using deep learning: a numerical comparison of discretization schemes
• Deep neural network approximations for Monte Carlo algorithms
• Neural networks-based algorithms for stochastic control and PDEs in finance
• Generalised multilevel Picard approximations
• Convergence of Deep Fictitious Play for Stochastic Differential Games
• Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing
• Multilevel Picard approximations for high-dimensional semilinear second-order PDEs with Lipschitz nonlinearities
• Deep learning algorithms for solving high dimensional nonlinear backward stochastic differential equations
• Deep learning based numerical approximation algorithms for stochastic partial differential equations
• Computing non-equilibrium trajectories by a deep learning approach
• Solving high-dimensional parabolic PDEs using the tensor train format
• Splitting physics-informed neural networks for inferring the dynamics of integer- and fractional-order neuron models
• Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures
• Solving PDEs on Unknown Manifolds with Machine Learning
• Solving path dependent PDEs with LSTM networks and path signatures
• Neural Network Approximation of Optimal Controls for Stochastic Reaction-Diffusion Equations
• An energy-based deep splitting method for the nonlinear filtering problem
• Deep Learning for Constrained Utility Maximisation
• XNet-Enhanced Deep BSDE Method and Numerical Analysis