4 papers
Beyond Layer Importance in Layer-wise Sparsity: An Inter-Layer Perturbation-Absorption Perspective
Tao Jing, Ningxin Wu, Chen Kang +3
The considerable layer-wise redundancy in large language models (LLMs) has established non-uniform sparsity allocation across layers as the standard pruning approach for efficient…
HybridThinker: Efficient Chain-of-Thought Reasoning via Compressed Memory and Transient Thought Steps
Xin Liu, Runsong Zhao, Xinyu Liu +8
Extended chain-of-thought (CoT) traces improve LLM reasoning but incur substantial computational and memory costs. While existing CoT compression methods mitigate this by condensin…
THRD: A Training-Free Multi-Turn Defense Framework for Jailbreak Attacks on Large Language Models
Zhiqing Ma, Zhonghao Xu, Dong Yu +3
Multi-turn jailbreak attacks pose a growing threat to LLMs by exploiting conversational dynamics such as gradual escalation and cross-turn coordination. Existing defenses either re…
RankNAS: Efficient Neural Architecture Search by Pairwise Ranking
Chi Hu, Chenglong Wang, Xiangnan Ma +5
This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples…