4 papers · 1 filter
Hint Tuning: Less Data Makes Better Reasoners
Siqi Fan, Minghao Li, Xiaoqian Ma +6
Large reasoning models achieve high accuracy through extended chain-of-thought but generate 5--8 more tokens than necessary, applying verbose reasoning uniformly regardless of prob…
If an LLM Were a Character, Would It Know Its Own Story? Evaluating Lifelong Learning in LLMs
Siqi Fan, Xiusheng Huang, Yiqun Yao +6
Large language models (LLMs) can carry out human-like dialogue, but unlike humans, they are stateless due to the superposition property. However, during multi-turn, multi-agent int…
Position-Aware Depth Decay Decoding (): Boosting Large Language Model Inference Efficiency
Siqi Fan, Xuezhi Fang, Xingrun Xing +3
Due to the large number of parameters, the inference phase of Large Language Models (LLMs) is resource-intensive. Unlike traditional model compression, which needs retraining, rece…
The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models
Siqi Fan, Bowen Qin, Peng Han +3
Recent thinking models trained with reinforcement learning and backward-checking CoT often suffer from overthinking: they produce excessively long outputs even on simple problems,…