Sycophancy Claims about Language Models: The Missing Human-in-the-Loop

Jan Batzner, Volker Stocker, Stefan Schmid +1

Sycophantic response patterns in Large Language Models (LLMs) have been increasingly claimed in the literature. We review methodological challenges in measuring LLM sycophancy and…