Robust $Q$-learning Algorithm for Markov Decision Processes under Wasserstein Uncertainty

Ariel Neufeld, Julian Sester

We present a novel $Q$-learning algorithm tailored to solve distributionally robust Markov decision problems where the corresponding ambiguity set of transition probabilities for t…