Generation Order and Parallel Decoding in Masked Diffusion Models: An Information-Theoretic Perspective

Shaorong Zhang, Longxuan Yu, Rob Brekelmans +3

Masked Diffusion Models (MDMs) significantly accelerate inference by trading off sequential determinism. However, the theoretical mechanisms governing generation order and the risk…