Reward Model Perspectives: Whose Opinions Do Reward Models Reward?

Elle

Reward models (RMs) are central to the alignment of language models (LMs). An RM often serves as a proxy for human preferences to guide downstream LM behavior. However, our underst…