4 papers · 1 filter
ALPS: Attention Localization and Pruning Strategy for Efficient Alignment of Large Language Models
Hao Chen, Haoze Li, Zhiqing Xiao +6
Aligning general-purpose large language models (LLMs) to downstream tasks often incurs significant training adjustment costs. Prior research has explored various avenues to enhance…
FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts
Xinyi Wang, Lirong Gao, Haobo Wang +2
Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a widely adopted strategy for adapting pre-trained Large Language Models (LLMs) to downstream tasks, significantly re…
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization
Qi Zhang, Shouqing Yang, Lirong Gao +8
Large language models (LLMs) have demonstrated impressive capabilities in reasoning with the emergence of reasoning models like OpenAI-o1 and DeepSeek-R1. Recent research focuses o…
D.Va: Validate Your Demonstration First Before You Use It
Qi Zhang, Zhiqing Xiao, Ruixuan Xiao +2
In-context learning (ICL) has demonstrated significant potential in enhancing the capabilities of large language models (LLMs) during inference. It's well-established that ICL heav…