Looped Diffusion Language Models

Sanghyun Lee, Chunsan Hong, Seungryong Kim +3

Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models for language modeling, yet the effective design of transformer architectures for MDM…