An Analysis of Training-Free Self-Reported Confidence in Language Models

Lukas Meyer, Sofia Rossi, Wei Chen +2

Large language models can report a numerical confidence together with generated content, but it is unclear whether this report is more than calibrated rhetoric. We analyze three tr…