ARA: Adaptive Rank Allocation for Efficient Large Language Model SVD Compression

Lin Xv, Jingsheng Gao, Xian Gao +2

In the field of large language model (LLM) compression, singular value decomposition (SVD) is a widely studied and adopted low-rank decomposition technique. Since SVD operates excl…