Robust Offline Reinforcement Learning with Linearly Structured f-Divergence Regularization

Cheng Tang, Zhishuai Liu, Pan Xu

The Robust Regularized Markov Decision Process (RRMDP) is proposed to learn policies robust to dynamics shifts by adding regularization to the transition dynamics in the value func…