Support Before Frequency in Discrete Diffusion

Adrian Müller, Antoine Gonon, Zebang Shen +2

Discrete diffusion models are increasingly competitive for language modeling, yet it remains unclear how their denoising objectives organize learning. Although these objectives tar…