The Phenomenology of Hallucinations

Valeria Ruscio, Keiran Thompson

We show that language models hallucinate not because they fail to detect uncertainty, but because of a failure to integrate it into output generation. Across architectures, uncerta…