Mind the Model, Not the Agent: The Primacy Bias in Model-based RL

Zhongjian Qiao, Jiafei Lyu, Xiu Li

The primacy bias in model-free reinforcement learning (MFRL), which refers to the agent's tendency to overfit early data and lose the ability to learn from new data, can significan…