Not Your Typical Sycophant: The Elusive Nature of Sycophancy in Large Language Models

Shahar Ben Natan, Oren Tsur

We propose a novel way to evaluate sycophancy of LLMs in a direct and neutral way, mitigating various forms of uncontrolled bias, noise, or manipulative language, deliberately inje…