On the Role of Discreteness in Diffusion LLMs

Ziqi Jin, Bin Wang, Xiang Lin +2

Diffusion models offer appealing properties for language generation, such as parallel decoding and iterative refinement, but the discrete and highly structured nature of text chall…