12 citations · 15 across the 17 of their papers we have counts for
4 papers · 1 filter
A Concentration Bound for LSPE()
Siddharth Chandak, Vivek S. Borkar, Harsh Dolhare
The popular LSPE() algorithm for policy evaluation is revisited to derive a concentration bound that gives high probability performance guarantees from some time on.
Concentration of Contractive Stochastic Approximation and Reinforcement Learning
Siddharth Chandak, Vivek S. Borkar, Parth Dodhia
Using a martingale concentration inequality, concentration bounds `from time on' are derived for stochastic approximation algorithms with contractive maps and both martingale…
Prospect-theoretic Q-learning
Vivek S. Borkar, Siddharth Chandak
We consider a prospect theoretic version of the classical Q-learning algorithm for discounted reward Markov decision processes, wherein the controller perceives a distorted and noi…
Hidden Markov Model-Based Encoding for Time-Correlated IoT Sources
Siddharth Chandak, Federico Chiariotti, Petar Popovski
As the use of Internet of Things (IoT) devices for monitoring purposes becomes ubiquitous, the efficiency of sensor communication is a major issue for the modern Internet. Channel…