Q-Learning under Finite Model Uncertainty

Julian Sester, Cécile Decker

We propose a robust Q-learning algorithm for Markov decision processes under model uncertainty when each state-action pair is associated with a finite ambiguity set of candidate tr…