Dynamic Programming-Compatible Uncertainty Sets in Robust Markov Decision Processes

Julien Grand-Clément, Nian Si, Shengbo Wang

In this paper, we investigate the compatibility of robust Markov Decision Processes (RMDPs) with dynamic programming under various assumptions on the uncertainty set, i.e., we inve…