Can Distillation Mitigate Backdoor Attacks in Pre-trained Encoders?

TIngxu Han, Wei Song, Weisong Sun +7

Self-Supervised Learning (SSL) has become a prominent paradigm for pre-training encoders to learning general-purpose representations from unlabeled data and releasing them on third…