From RLHF to Direct Alignment: A Theoretical Unification of Preference Learning for Large Language Models

Tarun Raheja, Nilay Pochhi

Aligning large language models (LLMs) with human preferences has become essential for safe and beneficial AI deployment. While Reinforcement Learning from Human Feedback (RLHF) est…