Efficient Algorithms for Robust Markov Decision Processes with $s$-Rectangular Ambiguity Sets

Chin Pang Ho, Marek Petrik, Wolfram Wiesemann

Robust Markov decision processes (MDPs) have attracted significant interest due to their ability to protect MDPs from poor out-of-sample performance in the presence of ambiguity. I…