5 papers · 1 filter
Nonlinear Stochastic Optimal Control and Optimal Stopping using the Fokker-Planck Transformation
Akan Selim, Siddhartha Ganguly, Ali Pakniyat +1
In this paper, we develop a theoretical framework for nonlinear stochastic optimal control problems with optimal stopping by establishing a density-based deterministic representati…
A Time-Reversal Control Synthesis for Steering the State of Stochastic Systems
Yuhang Mei, Amirhossein Taghvaei, Ali Pakniyat
This paper presents a novel approach for steering the state of a stochastic control-affine system to a desired target within a finite time horizon. Our method leverages the time-re…
Solving Feynman-Kac Forward Backward SDEs Using McKean-Markov Branched Sampling
Kelsey P. Hawkins, Ali Pakniyat, Evangelos Theodorou +1
We propose a new method for the numerical solution of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value functi…
Value Function Estimators for Feynman-Kac Forward-Backward SDEs in Stochastic Optimal Control
Kelsey P. Hawkins, Ali Pakniyat, Panagiotis Tsiotras
Two novel numerical estimators are proposed for solving forward-backward stochastic differential equations (FBSDEs) appearing in the Feynman-Kac representation of the value functio…
Forward-Backward Rapidly-Exploring Random Trees for Stochastic Optimal Control
Kelsey P. Hawkins, Ali Pakniyat, Evangelos Theodorou +1
We propose a numerical method for the computation of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value functio…