4 papers
Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models
Miao Li, Hanyang Jiang, Hengyu Fu +8
Diffusion language models (DLMs) enable flexible parallel generation by resolving tokens according to the model's evolving predictability rather than a fixed left-to-right order. T…
Agents' Last Exam
Yiyou Sun, Xinyang Han, Weichen Zhang +378
Recent AI systems have achieved strong results on a wide range of benchmarks, yet these gains have not translated into economically meaningful deployment across many professional d…
Plan, Verify and Fill: A Structured Parallel Decoding Approach for Diffusion Language Models
Miao Li, Hanyang Jiang, Sikai Cheng +6
Diffusion Language Models (DLMs) present a promising non-sequential paradigm for text generation, distinct from standard autoregressive (AR) approaches. However, current decoding s…
From Bits to Rounds: Parallel Decoding with Exploration for Diffusion Language Models
Hengyu Fu, Baihe Huang, Virginia Adams +3
Diffusion Language Models (DLMs) have recently emerged as a strong alternative to autoregressive language models (LMs). DLMs offer comparable accuracy with faster inference speed v…