RUSH: Robust Contrastive Learning via Randomized Smoothing

Yijiang Pang, Boyang Liu, Jiayu Zhou

Recently, adversarial training has been incorporated in self-supervised contrastive pre-training to augment label efficiency with exciting adversarial robustness. However, the robu…