Offline Retraining for Online RL: Decoupled Policy Learning to Mitigate Exploration Bias

Max Sobol Mark, Archit Sharma, Fahim Tajwar +3

It is desirable for policies to optimistically explore new states and behaviors during online reinforcement learning (RL) or fine-tuning, especially when prior offline data does no…