Verbalized and Internal Probabilities Are Coupled in Large Language Models

Sinead Williamson, Jiaxuan Li, Nick Foti +2

Large language models carry an internal notion of uncertainty in their sampling distribution, i.e., the probabilities they place on generating one answer rather than another. They…