Solving stochastic optimal control problem via stochastic maximum principle with deep learning method

Abstract

In this paper, we aim to solve the high dimensional stochastic optimal control problem from the view of the stochastic maximum principle via deep learning. By introducing the extended Hamiltonian system which is essentially an FBSDE with a maximum condition, we reformulate the original control problem as a new one. Three algorithms are proposed to solve the new control problem. Numerical results for different examples demonstrate the effectiveness of our proposed algorithms, especially in high dimensional cases. And an important application of this method is to calculate the sub-linear expectations, which correspond to a kind of fully nonlinear PDEs.

References in corpus (6)

• Solving high-dimensional partial differential equations using deep learning
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• Deep Learning Approximation for Stochastic Control Problems
• Deep neural networks algorithms for stochastic control problems on finite horizon: convergence analysis
• Neural networks-based algorithms for stochastic control and PDEs in finance