Accelerating Value Iteration with Anchoring

Jongmin Lee, Ernest K. Ryu

Value Iteration (VI) is foundational to the theory and practice of modern reinforcement learning, and it is known to converge at a $\mathcal{O}({\gamma }^k)$-rate, where $\gamma$ is the discoun…