SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels

Henry Hengyuan Zhao, Pichao Wang, Yuyang Zhao +3

Pre-trained vision transformers have strong representation benefits to various downstream tasks. Recently, many parameter-efficient fine-tuning (PEFT) methods have been proposed, a…