Why Language Models Hallucinate

Adam Tauman Kalai, Ofir Nachum, Santosh S. Vempala +1

Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty. Such…