Retrofitting Linear Attention into Diffusion Language Models

Jinha Kim, Younghun Roh, Jaeyeon Kim

Diffusion language models (dLLMs) offer a promising alternative to autoregressive models by accelerating inference through parallel decoding. Recent dLLMs commonly use blockwise se…