Feynman-Kac representation for Hamilton-Jacobi-Bellman IPDE

Abstract

We aim to provide a Feynman-Kac type representation for Hamilton-Jacobi-Bellman equation, in terms of forward backward stochastic differential equation (FBSDE) with a simulatable forward process. For this purpose, we introduce a class of BSDE where the jumps component of the solution is subject to a partial nonpositive constraint. Existence and approximation of a unique minimal solution is proved by a penalization method under mild assumptions. We then show how minimal solution to this BSDE class provides a new probabilistic representation for nonlinear integro-partial differential equations (IPDEs) of Hamilton-Jacobi-Bellman (HJB) type, when considering a regime switching forward SDE in a Markovian framework, and importantly we do not make any ellipticity condition. Moreover, we state a dual formula of this BSDE minimal solution involving equivalent change of probability measures. This gives in particular an original representation for value functions of stochastic control problems including controlled diffusion coefficient.

Published at http://dx.doi.org/10.1214/14-AOP920 in the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (5)

• Second-Order Elliptic Integro-Differential Equations: Viscosity Solutions' Theory Revisited
• A numerical algorithm for fully nonlinear HJB equations: an approach by control randomization
• Discrete time approximation of fully nonlinear HJB equations via BSDEs with nonpositive jumps
• Counterparty Risk Valuation: A Marked Branching Diffusion Approach
• Dual and backward SDE representation for optimal control of non-Markovian SDEs

Cited by in corpus (15)

• A numerical algorithm for fully nonlinear HJB equations: an approach by control randomization
• Discrete time approximation of fully nonlinear HJB equations via BSDEs with nonpositive jumps
• Learning Deep Stochastic Optimal Control Policies using Forward-Backward SDEs
• Perron's method for nonlocal fully nonlinear equations
• Dual and backward SDE representation for optimal control of non-Markovian SDEs
• Stochastic Near-Optimal Controls for Path-Dependent Systems
• Ergodic BSDEs driven by G-Brownian motion and their applications
• Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation
• Solving non-Markovian Stochastic Control Problems driven by Wiener Functionals
• BSDEs with diffusion constraint and viscous Hamilton-Jacobi equations with unbounded data
• Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
• Constrained BSDEs representation of the value function in optimal control of pure jump Markov processes
• Non-Markovian optimal stopping problems and constrained BSDEs with jump
• Ergodic Control of Infinite Dimensional SDEs with Degenerate Noise
• Backward SDEs and infinite horizon stochastic optimal control