Gradient-based Fine-Tuning through Pre-trained Model Regularization

Xuanbo Liu, Liu Liu, Fuxiang Wu +2

Large pre-trained models have demonstrated extensive applications across various fields. However, fine-tuning these models for specific downstream tasks demands significant computa…