Linear Convergence of Natural Policy Gradient Methods with Log-Linear Policies

Rui Yuan, Simon S. Du, Robert M. Gower +2

We consider infinite-horizon discounted Markov decision processes and study the convergence rates of the natural policy gradient (NPG) and the Q-NPG methods with the log-linear pol…