See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition

Chongjie Si, Xiaokang Yang, Wei Shen

The rapid expansion of large foundation models within the pre-training and fine-tuning framework has underscored that larger models often yield better results. However, the scaling…