How Much Do You Trust A Dog? Quantifying Hint-Following in Reasoning Language Models

Anxin Guo, Chirag Pabbaraju, Sara Ahmadian +2

Large language models (LLMs) often exhibit sycophancy, altering their answers to align with user suggestions even on objective factual and reasoning tasks. Yet the quantitative for…