RMB: Reward Model Boosting Mitigates Reward Hacking

Jiabin Fan, Dezhi Ye, Yongchang Hao +1

Reinforcement Learning from Human Feedback (RLHF) is a powerful technique for aligning large language models (LLMs) with human preference. However, it often suffers from the reward…