MixMask: Revisiting Masking Strategy for Siamese ConvNets

Kirill Vishniakov, Eric Xing, Zhiqiang Shen

The recent progress in self-supervised learning has successfully combined Masked Image Modeling (MIM) with Siamese Networks, harnessing the strengths of both methodologies. Nonethe…