Evaluating Reward Model Generalization via Pairwise Maximum Discrepancy Competitions

Shunyang Luo, Peibei Cao, Zhihui Zhu +3

Reward models (RMs) are central to aligning large language models, yet their practical effectiveness hinges on generalization to unseen prompts and shifting distributions. Most exi…