3 papers
cs.LG2024
Concentration of Cumulative Reward in Markov Decision Processes
Borna Sayedana, Peter E. Caines, Aditya Mahajan
In this paper, we investigate the concentration properties of cumulative reward in Markov Decision Processes (MDPs), focusing on both asymptotic and non-asymptotic settings. We int…
cs.LG2021
Strong Consistency and Rate of Convergence of Switched Least Squares System Identification for Autonomous Markov Jump Linear Systems
Borna Sayedana, Mohammad Afshari, Peter E. Caines +1
In this paper, we investigate the problem of system identification for autonomous Markov jump linear systems (MJS) with complete state observations. We propose switched least squar…
cs.IT2019
Counterexamples on the monotonicity of delay optimal strategies for energy harvesting transmitters
Borna Sayedana, Aditya Mahajan
We consider cross-layer design of delay optimal transmission strategies for energy harvesting transmitters where the data and energy arrival processes are stochastic. Using Markov…