Personalized Alignment of Language Models with Human Value Profiles

Rashon Poole, Farnaz Jahanbakhsh

Large language models are increasingly used for subjective tasks such as seeking advice, where there is often no single correct answer. Yet dominant alignment methods learn a singl…