Large Language Diffusion Models

Shen Nie, Fengqi Zhu, Zebin You +7

The capabilities of large language models (LLMs) are widely regarded as relying on autoregressive models (ARMs). We challenge this notion by introducing LLaDA, a diffusion model tr…