Residual Context Diffusion Language Models

Yuezhou Hu, Harman Singh, Monishwaran Maheswaran +10

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to purely autoregressive language models because they can decode multiple tokens in parallel. Howeve…