RSRA: Training-Free Probing of Representation Sensitivity for Efficient LoRA Rank Allocation

Jiaqi Liu, Haidong Kang, Qihui Zhao +2

Parameter-efficient fine-tuning enables large language models to adapt to downstream tasks with substantially lower computational and storage cost, and Low-Rank Adaptation (LoRA) i…