Towards a Theoretical Understanding to the Generalization of RLHF

Zhaochun Li, Mingyang Yi, Yue Wang +2

Reinforcement Learning from Human Feedback (RLHF) and its variants have emerged as the dominant approaches for aligning Large Language Models with human intent. While empirically e…