13 citations · 38 across the 16 of their papers we have counts for
Showing 2015Show all
3 papers · 1 filter
eess.SY2015
Stability of Stochastic Approximations with `Controlled Markov' Noise and Temporal Difference Learning
Arunselvan Ramaswamy, Shalabh Bhatnagar
We are interested in understanding stability (almost sure boundedness) of stochastic approximation algorithms (SAs) driven by a `controlled Markov' process. Analyzing this class of…
eess.SY2015★ 6 cited
Stochastic recursive inclusion in two timescales with an application to the Lagrangian dual problem
Arunselvan Ramaswamy, Shalabh Bhatnagar
In this paper we present a framework to analyze the asymptotic behavior of two timescale stochastic approximation algorithms including those with set-valued mean fields. This paper…
eess.SY2015
A Generalization of the Borkar-Meyn Theorem for Stochastic Recursive Inclusions
Arunselvan Ramaswamy, Shalabh Bhatnagar
In this paper the stability theorem of Borkar and Meyn is extended to include the case when the mean field is a differential inclusion. Two different sets of sufficient conditions…