A Principled Loss Function for Direct Language Model Alignment

Yuandong Tan

The alignment of large language models (LLMs) with human preferences is commonly achieved through Reinforcement Learning from Human Feedback (RLHF). Direct Preference Optimization…