Nash Learning from Human Feedback

Rémi Munos, Michal Valko, Daniele Calandriello +14

Reinforcement learning from human feedback (RLHF) has emerged as the main paradigm for aligning large language models (LLMs) with human preferences. Typically, RLHF involves the in…