On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning

Baptiste Bonin, Caro Strickland, Audrey Durand

Hindsight relabeling which retroactively replacing a transition's goal with the outcome the agent actually achieved is an effective tool for improving sample-efficiency in Reinforc…