SelFusion: Self-distillation for Diffusion Language Models

Hyeongsoo Lim, Jinyoung Kim, Eunseo Seo +2

Diffusion language models (DLMs) alleviate the inherent latency bottleneck of autoregressive (AR) large language models (LLMs), but their degraded generation quality limits practic…