Efficient Vision-Language Pre-training by Cluster Masking

Zihao Wei, Zixuan Pan, Andrew Owens

We propose a simple strategy for masking image patches during visual-language contrastive learning that improves the quality of the learned representations and the training speed.…