Expanding Sparse Tuning for Low Memory Usage

Shufan Shen, Junshu Sun, Xiangyang Ji +2

Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained vision models to downstream tasks by tuning a small subset of parameters. Among PEFT methods,…