How to Evaluate Reward Models for RLHF

Evan Frick, Tianle Li, Connor Chen +6

We introduce a new benchmark for reward models that quantifies their ability to produce strong language models through RLHF (Reinforcement Learning from Human Feedback). The gold-s…