Sequential Diffusion Language Models

Yangzhou Liu, Yue Cao, Hao Li +13

Diffusion language models (DLMs) have strong theoretical efficiency but are limited by fixed-length decoding and incompatibility with key-value (KV) caches. Block diffusion mitigat…