Sycophantic Agreement Transfers with Neutral Data via Contrastive Preference Optimization

Camila Blank, Zhuofan Ying, Christopher Potts +2

Sycophantic agreement refers to a behavior in which language models excessively affirm the user, often at the cost of factual accuracy. Although sycophantic agreement is a well-kno…