Mitigating LLM sycophancy with RL-based fine-tuning: Bayesian Truth Serum approach

Serhii Mytsyk, Yiming Zhang, Vikram Krishnamurthy

Large language models (LLMs) frequently exhibit \emph{sycophancy}: they adapt their answers to a user's stated beliefs or preferences instead of reporting what they hold to be true…