Bringing Stability to Diffusion: Decomposing and Reducing Variance of Training Masked Diffusion Models

Mengni Jia, Mengyu Zhou, Yihao Liu +2

Masked diffusion models (MDMs) are a promising alternative to autoregressive models (ARMs), but they suffer from inherently much higher training variance. High variance leads to no…