Spectral Souping: A Unified Framework for Online Preference Alignment

Yinlam Chow, Guy Tennenholtz, Ted Yun +4

Reinforcement Learning from Human Feedback (RLHF) effectively aligns Large Language Models (LLMs) with aggregate human preferences but often fails to address the diverse and confli…