Teaching Models to Verbalize Reward Hacking in Chain-of-Thought Reasoning

Miles Turpin, Andy Arditi, Marvin Li +2

Language models trained with reinforcement learning (RL) can engage in reward hacking--the exploitation of unintended strategies for high reward--without revealing this behavior in…