Transformer-Based Masked Diffusion Models Provably Learn Distributions with Latent Structure

Jingda Wu, Changxiao Cai

Masked diffusion models (MDMs) generate discrete data by iteratively unmasking multiple tokens in parallel using a learned mask predictor. Their output carries two errors: parallel…