Policy Mirror Descent with Temporal Difference Learning: Sample Complexity under Online Markov Data

Wenye Li, Hongxu Chen, Jiacai Liu +1

This paper studies the policy mirror descent (PMD) method, which is a general policy optimization framework in reinforcement learning and can cover a wide range of policy gradient…