Unsure but Certain: Uncovering the Representation-Confidence Gap in Diffusion Language Models

Saurabh Yadav, Badri Narayana Patro, Vijay Srinivas Agneeswaran

Diffusion language models use broad context to create text, suggesting they might handle input noise better than standard models. Testing reveals this is only partially true. Inter…