Projected Off-Policy Q-Learning (POP-QL) for Stabilizing Offline Reinforcement Learning

Melrose Roderick, Gaurav Manek, Felix Berkenkamp +1

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the lear…