979 citations · 1k across the 15 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
stat.ML2021
A Statistical Analysis of Polyak-Ruppert Averaged Q-learning
Xiang Li, Wenhao Yang, Jiadong Liang +2
We study Q-learning with Polyak-Ruppert averaging in a discounted Markov decision process in synchronous and tabular settings. Under a Lipschitz condition, we establish a functiona…
stat.ML2021★ 3 cited
Towards Theoretical Understandings of Robust Markov Decision Processes: Sample Complexity and Asymptotics
Wenhao Yang, Liangyu Zhang, Zhihua Zhang
In this paper, we study the non-asymptotic and asymptotic performances of the optimal robust policy and value function of robust Markov Decision Processes(MDPs), where the optimal…