Compression Precedes, Content Decides: Emergent Misalignment in Reward Models

Dhruv Puri, Nikhil Prakash

Emergent Misalignment - the out of domain generalization of narrow harmful fine-tuning first shown by Betley et al. [2025] has been widely studied in language models but not in rew…