Empirical Dynamic Programming

William B. Haskell, Rahul Jain, Dileep Kalathil

We propose empirical dynamic programming algorithms for Markov decision processes (MDPs). In these algorithms, the exact expectation in the Bellman operator in classical value iter…