5 papers
Beyond the Training Horizon: Mechanisms and Limits of Length Generalization in Looped Transformers
Jia Liang, Xi Jin, Liangming Pan
Looped Transformers can generalize to reasoning chains longer than those encountered during training, but the computations enabling this behavior and limiting its extent remain unc…
Do Latent-CoT Models Think Step-by-Step? A Mechanistic Study on Sequential Reasoning Tasks
Jia Liang, Liangming Pan
Latent Chain-of-Thought aims to enable step-by-step computation without emitting long rationales, yet its internal mechanisms remain unclear. We study CODI, a continuous-thought te…
ToC: Tree-of-Claims Search with Multi-Agent Language Models
Shuyang Yu, Jianan Liang, Hui Hu
Optimizing patent claims is a critical yet challenging task, demanding careful balance between maximizing novelty and preserving legal scope. Manual claim drafting is labor-intensi…
SafeRBench: Dissecting the Reasoning Safety of Large Language Models
Xin Gao, Shaohan Yu, Zerui Chen +8
Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness P…
ReaLM: Reflection-Enhanced Autonomous Reasoning with Small Language Models
Yuanfeng Xu, Zehui Dai, Jian Liang +4
Small Language Models (SLMs) are a cost-effective alternative to Large Language Models (LLMs), but often struggle with complex reasoning due to their limited capacity and a tendenc…