4 papers · 1 filter
AdaJudge: Adaptive Multi-Perspective Judging for Reward Modeling
Yongliang Miao, Yangyang Liang, Mengnan Du
Reward modeling is essential for aligning large language models with human preferences, yet predominant architectures rely on a static pooling strategy to condense sequences into s…
DeepSieve: Information Sieving via LLM-as-a-Knowledge-Router
Minghao Guo, Qingcheng Zeng, Xujiang Zhao +5
Large Language Models (LLMs) excel at many reasoning tasks but struggle with knowledge-intensive queries due to their inability to dynamically access up-to-date or domain-specific…
NeuronScope: A Multi-Agent Framework for Explaining Polysemantic Neurons in Language Models
Weiqi Liu, Yongliang Miao, Haiyan Zhao +2
Neuron-level interpretation in large language models (LLMs) is fundamentally challenged by widespread polysemanticity, where individual neurons respond to multiple distinct semanti…
Kwai-STaR: Transform LLMs into State-Transition Reasoners
Xingyu Lu, Yuhang Hu, Changyi Liu +12
Mathematical reasoning presents a significant challenge to the cognitive capabilities of LLMs. Various methods have been proposed to enhance the mathematical ability of LLMs. Howev…