Harness-agnostic detection and immunization of reward hacking in self-evolving language models

Rongxin Yang, Yang Liu, Shang Luo +10

Self-evolving language models improve by proposing candidate updates and keeping whatever raises a visible score. When that score is an imperfect proxy for the capability one actua…