Does Combining Parameter-efficient Modules Improve Few-shot Transfer Accuracy?

Nader Asadi, Mahdi Beitollahi, Yasser Khalil +3

Parameter-efficient fine-tuning stands as the standard for efficiently fine-tuning large language and vision models on downstream tasks. Specifically, the efficiency of low-rank ad…