Train Large, Deploy Compact: Structured Compression for Compact Low-Rank Adaptation

Xin Yu, Cong Xie, Xunmei Liu +3

Low-rank adaptation (LoRA) has become a widely used paradigm for parameter-efficient fine-tuning of large language models, yet its representational capacity often lags behind full…