Improving Fine-tuning of Self-supervised Models with Contrastive Initialization

Haolin Pan, Yong Guo, Qinyi Deng +3

Self-supervised learning (SSL) has achieved remarkable performance in pretraining the models that can be further used in downstream tasks via fine-tuning. However, these self-super…