Deep neural networks algorithms for stochastic control problems on finite horizon: numerical applications

Abstract

This paper presents several numerical applications of deep learning-based algorithms that have been introduced in [HPBL18]. Numerical and comparative tests using TensorFlow illustrate the performance of our different algorithms, namely control learning by performance iteration (algorithms NNcontPI and ClassifPI), control learning by hybrid iteration (algorithms Hybrid-Now and Hybrid-LaterQ), on the 100-dimensional nonlinear PDEs examples from [EHJ17] and on quadratic backward stochastic differential equations as in [CR16]. We also performed tests on low-dimension control problems such as an option hedging problem in finance, as well as energy storage problems arising in the valuation of gas storage and in microgrid management. Numerical results and comparisons to quantization-type algorithms Qknn, as an efficient algorithm to numerically solve low-dimensional control problems, are also provided; and some corresponding codes are available on https://github.com/comeh/.

39 pages, 14 figures. Methodology and Computing in Applied Probability, Springer Verlag, In press

References in corpus (1)

• Deep neural networks algorithms for stochastic control problems on finite horizon: convergence analysis

Cited by in corpus (6)

• Deep Fictitious Play for Stochastic Differential Games
• Risk management with machine-learning-based algorithms
• Market making and incentives design in the presence of a dark pool: a deep reinforcement learning approach
• Lax-Oleinik-type formulas and efficient algorithms for certain high-dimensional optimal control problems
• Deep neural network for optimal retirement consumption in defined contribution pension system
• Hopf-type representation formulas and efficient algorithms for certain high-dimensional optimal control problems