Improving Discrete Diffusion Unmasking Policies Beyond Explicit Reference Policies

Chunsan Hong, Seonho An, Min-Soo Kim +1

Masked diffusion models (MDMs) have recently emerged as a novel framework for language modeling. MDMs generate sentences by iteratively denoising masked sequences, filling in [MASK…