6 papers
Uncertainty-Aware Budget Allocation for Efficient LLM Tree Search
Jianguo Huang, Zhiyi Lyu, Fuxiang Zhang +3
Tree search enhances multi-step reasoning in large language models (LLMs), yet prevailing methods expand every step with a fixed budget, irrespective of the marginal utility of exp…
Prism-1: Position- and Rival-Independent Scoring for System One Models
Yao Long Teng, Jianguo Huang, Yanchen Deng +2
Given a state and a set of options, such as intents, tools or interface elements, System One decision models return a distribution over the options in one forward pass, without gen…
Consider, Then Choose: Order-Invariant Decisions in System One Models
Jianguo Huang, Yao Long Teng, Yanchen Deng +1
System One models answer typed questions in a single forward pass and promise the same answer for the same input. For choice questions, this promise fails: the answer depends on th…
Hesitation-Aware On-Policy Distillation for Diffusion Language Models
Jianguo Huang, Lipeng Wan, Yanchen Deng +1
Diffusion large language models (dLLMs) generate text by iterative unmasking. At each denoising step, a dLLM proposes a token at every masked position, but the decoder commits only…
Let's Revise Step-by-Step: A Unified Local Search Framework for Code Generation with LLMs
Zhiyi Lyu, Jianguo Huang, Yanchen Deng +2
Large Language Models (LLMs) with inference-time scaling techniques show promise for code generation, yet face notable efficiency and scalability challenges. Construction-based tre…
GDBA Revisited: Unleashing the Power of Guided Local Search for Distributed Constraint Optimization
Yanchen Deng, Xinrun Wang, Bo An
Local search is an important class of incomplete algorithms for solving Distributed Constraint Optimization Problems (DCOPs) but it often converges to poor local optima. While Gene…