Tight Performance Bounds for Approximate Modified Policy Iteration with Non-Stationary Policies

Boris Lesner, Bruno Scherrer

We consider approximate dynamic programming for the infinite-horizon stationary $\gamma$-discounted optimal control problem formalized by Markov Decision Processes. While in the exact c…