Variance-Reduced Cascade Q-learning: Algorithms and Sample Complexity

Mohammad Boveiri, Peyman Mohajerin Esfahani

We study the problem of estimating the optimal Q-function of ${\hat{I}}^3$-discounted Markov decision processes (MDPs) under the synchronous setting, where independent samples for all state…