Generative Reward Models

Dakota Mahan, Duy Van Phung, Rafael Rafailov +6

Reinforcement Learning from Human Feedback (RLHF) has greatly improved the performance of modern Large Language Models (LLMs). The RLHF process is resource-intensive and technicall…