Pre-training CLIP against Data Poisoning with Optimal Transport-based Matching and Alignment

Tong Zhang, Kuofeng Gao, Jiawang Bai +5

Recent studies have shown that Contrastive Language-Image Pre-training (CLIP) models are threatened by targeted data poisoning and backdoor attacks due to massive training image-ca…