11 citations · 31 across the 16 of their papers we have counts for
3 papers · 1 filter
On the function approximation error for risk-sensitive reinforcement learning
Prasenjit Karmakar, Shalabh Bhatnagar
In this paper we obtain several informative error bounds on function approximation for the policy evaluation algorithm proposed by Basu et al. when the aim is to find the risk-sens…
On a convergent off -policy temporal difference learning algorithm in on-line learning environment
Prasenjit Karmakar, Rajkumar Maity, Shalabh Bhatnagar
In this paper we provide a rigorous convergence analysis of a "off"-policy temporal difference learning algorithm with linear function approximation and per time-step linear comput…
Dynamics of stochastic approximation with iterate-dependent Markov noise under verifiable conditions in compact state space with the stability of iterates not ensured
Prasenjit Karmakar, Shalabh Bhatnagar
This paper compiles several aspects of the dynamics of stochastic approximation algorithms with Markov iterate-dependent noise when the iterates are not known to be stable beforeha…