Random Remasking Scales Masked Diffusion Inference

Zhaoyi Zhou, Frank Wu, Andrea Zanette

Masked diffusion models (MDMs) generate sequences by progressively unmasking tokens, but errors introduced during decoding are typically irreversible. Recent work has shown that it…