19 papers
Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion Language Models
Xuning He, Zinan Sheng, Yongding Tao +4
Diffusion language models (DLMs) iteratively refine a sequence, allowing earlier predictions to be revised as context evolves. This rollback capability distinguishes them from irre…
Efficient Grammar-Constrained Decoding via Parser Stack Classification
Yongmin Li, Yihong Dong, Jia Li +1
LLMs are widely used to generate structured output like source code or JSON. Grammar-constrained decoding (GCD) can guarantee the syntactic validity of the generated output, by mas…
ClarifyCodeBench: Evaluating LLMs on Clarifying Ambiguous Requirements for Code Generation
Zheng Fang, Dongming Jin, Yihong dong +4
Large Language Models have emerged as programming assistants. However, the efficacy of code generation is constrained by the quality of input requirements, which are frequently amb…
From I/O to Code with Discovery Agent
Yihong Dong, Jiaru Qian, Haoran Zhang +7
The automatic synthesis of a program from any form of specification is regarded as a holy grail of computer science. Fueled by LLMs, NL2Code has achieved tremendous success, yet th…
Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model
Yihong Dong, Zhaoyu Ma, Xue Jiang +10
Diffusion language models (DLMs) are emerging as a compelling alternative to the dominant autoregressive paradigm, offering inherent advantages in parallel generation and bidirecti…
Think Anywhere in Code Generation
Xue Jiang, Tianyu Zhang, Ge Li +8
Recent advances in reasoning Large Language Models (LLMs) have primarily relied on upfront thinking, where reasoning occurs before final answer. However, this approach suffers from…