2 papers
cs.LG2025
Weight Spectra Induced Efficient Model Adaptation
Chongjie Si, Xuankun Yang, Muqing Liu +5
Large-scale foundation models have demonstrated remarkable versatility across a wide range of downstream tasks. However, fully fine-tuning these models incurs prohibitive computati…
cs.LG2025
MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
Chongjie Si, Zhiyi Shi, Yadao Wang +3
The rapid development of large language models has revolutionized natural language processing, but their fine-tuning remains computationally expensive, hindering broad deployment.…