Fast Rates for Offline Q-Learning with KL Regularization

Yize Hao, Guangxin Jiang, Shuang Qiu

This paper investigates offline Q-learning for finite-horizon Markov decision processes with Kullback-Leibler (KL) regularization. Recent studies have shown that KL regularization…