Tuning Pre-trained Model via Moment Probing

Mingze Gao, Qilong Wang, Zhenyi Lin +3

Recently, efficient fine-tuning of large-scale pre-trained models has attracted increasing research interests, where linear probing (LP) as a fundamental module is involved in expl…