Online Distributionally Robust LLM Alignment via Regression to Relative Reward

Sharan Sahu, Martin T. Wells

Reinforcement Learning with Human Feedback (RLHF) has become crucial for aligning Large Language Models (LLMs) with human intent. However, existing offline RLHF approaches suffer f…