Scaling up Masked Diffusion Models on Text

Shen Nie, Fengqi Zhu, Chao Du +5

Masked diffusion models (MDMs) have shown promise in language modeling, yet their scalability and effectiveness in core language tasks, such as text generation and language underst…