Introspective Diffusion Language Models

Yifan Yu, Yuqing Jian, Junxiong Wang +12

Diffusion language models promise parallel generation, yet still lag behind autoregressive (AR) models in quality. We stem this gap to a failure of introspective consistency: AR mo…