Mitigating Social Sycophancy via Pluralistic Preference Optimization

Stephane Hatgis-Kessell, Myra Cheng, Xiaoxuan Hou +4

Personal advice, including relationship advice, now ranks among the most common uses of generative AI. But language models (LMs) exhibit sycophancy: they affirm users much more oft…