When Do LLMs Admit Their Mistakes? Understanding The Role Of Model Belief In Retraction

Yuqing Yang, Robin Jia

We study the internal mechanisms that govern when LLMs choose to retract wrong answers, i.e., spontaneously and immediately acknowledge errors in their previously generated false a…