96 citations · 369 across the 74 of their papers we have counts for
21 papers · 1 filter
Multi Timescale Stochastic Approximation: Stability and Convergence
Rohan Deb, Swetha Ganesh, Shalabh Bhatnagar
This paper presents the first sufficient conditions that guarantee the stability and almost sure convergence of multi-timescale stochastic approximation (SA) iterates. It extends t…
A reinforcement learning approach to hybrid control design
Meet Gandhi, Atreyee Kundu, Shalabh Bhatnagar
In this paper we design hybrid control policies for hybrid systems whose mathematical models are unknown. Our contributions are threefold. First, we propose a framework for modelli…
A Stochastic Game Framework for Efficient Energy Management in Microgrid Networks
Shravan Nayak, Chanakya Ajit Ekbote, Annanya Pratap Singh Chauhan +5
We consider the problem of energy management in microgrid networks. A microgrid is capable of generating a limited amount of energy from a renewable resource and is responsible for…
A unified decision making framework for supply and demand management in microgrid networks
Diddigi Raghuram Bharadwaj, Sai Koti Reddy Danda, Krishnasuri Narayanam +1
This paper considers two important problems -- on the supply-side and demand-side respectively and studies both in a unified framework. On the supply side, we study the problem of…
Analyzing Approximate Value Iteration Algorithms
Arunselvan Ramaswamy, Shalabh Bhatnagar
In this paper, we consider the stochastic iterative counterpart of the value iteration scheme wherein only noisy and possibly biased approximations of the Bellman operator are avai…
A Linearly Relaxed Approximate Linear Program for Markov Decision Processes
Chandrashekar Lakshminarayanan, Shalabh Bhatnagar, Csaba Szepesvari
Approximate linear programming (ALP) and its variants have been widely applied to Markov Decision Processes (MDPs) with a large number of states. A serious limitation of ALP is tha…