Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model
Yuxuan Hu, Jing Zhang, Xiaodong Chen +3
Existing low-rank adaptation (LoRA) methods face challenges on sparse large language models (LLMs) due to the inability to maintain sparsity. Recent works introduced methods that m…
cs.CL2023
: Enhancing Structured Pruning via PCA Projection
Yuxuan Hu, Jing Zhang, Zhe Zhao +4
Structured pruning is a widely used technique for reducing the size of pre-trained language models (PLMs), but current methods often overlook the potential of compressing the hidde…