Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies

Sterre Lutz, Daniël Vos, Matthijs T. J. Spaan +1

Sequential decision-making in real-world applications often involves uncertainty about the environment's model. Uncertain Markov decision processes (UMDPs) represent the possible e…