Locating Sycophancy Across Training Stages in Open Language Models

Jiarui Yao, Shweta Parihar, Nghia Tuan Bui +2

Language model assistants sometimes change a correct answer when the user suggests a wrong one. The behavior, called sycophancy, is usually attributed to preference-based post-trai…