Mitigating Reward Hacking in Realistic Scenarios Through Representation Engineering

Austin Meek, Kyle Cox, Matthew Nguyen +2

Reward hacking is a major problem in current production machine learning systems, resulting in costly and dangerous failures. Here we study how to monitor for and mitigate reward h…