6 papers
Inference-Time Conformal Reasoning with Valid Factuality Control for Large Language Models
Ting Wang, Yuanjie Shi, Yan Yan +1
Large language models (LLMs) increasingly perform multi-step reasoning, where intermediate claims form implicit directed acyclic graphs whose node correctness is structurally condi…
Learning a Zeroth-Order Optimizer for Fine-Tuning LLMs
Kairun Zhang, Haoyu Li, Yanjun Zhao +2
Zeroth-order optimizers have recently emerged as an attractive approach for fine-tuning large language models (LLMs), as they avoid backpropagation and can substantially reduce mem…
DecepChain: Inducing Deceptive Reasoning in Large Language Models
Wei Shen, Han Wang, Haoyu Li +1
Large Language Models (LLMs) have been demonstrating strong reasoning capability with their chain-of-thoughts (CoT), which are routinely used by humans to judge answer quality. Thi…
On The Fragility of Benchmark Contamination Detection in Reasoning Models
Han Wang, Haoyu Li, Brian Ko +1
Leaderboards for LRMs have turned evaluation into a competition, incentivizing developers to optimize directly on benchmark suites. A shortcut to achieving higher rankings is to in…
When Reasoning Meets Its Laws
Junyu Zhang, Yifan Sun, Tianang Leng +4
Despite the superior performance of Large Reasoning Models (LRMs), their reasoning behaviors are often counterintuitive, leading to suboptimal reasoning capabilities. To theoretica…
AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time
Junyu Zhang, Runpei Dong, Han Wang +8
This paper presents AlphaOne (1), a universal framework for modulating reasoning progress in large reasoning models (LRMs) at test time. 1 first introduces moment, whi…