Fast Regularized Policy Mirror Descent with One-Step TD Updates

Qipei Chen, Wenye Li, Yule Sun +1

Policy mirror descent (PMD) enjoys fast convergence in regularized Markov decision processes (MDPs), but existing guarantees often rely on exact or increasingly accurate policy eva…