Continuously Augmented Discrete Diffusion model for Categorical Generative Modeling

Huangjie Zheng, Shansan Gong, Ruixiang Zhang +5

Standard discrete diffusion models treat all unobserved states identically by mapping them to an absorbing [MASK] token. This creates an 'information void' where semantic informati…