Taming OOD Actions for Offline Reinforcement Learning: An Advantage-Based Approach

Xuyang Chen, Keyu Yan, Wenhan Cao +1

Offline reinforcement learning (RL) learns policies from fixed datasets without online interactions, but suffers from distribution shift, causing inaccurate evaluation and overesti…