Suppressing Non-Semantic Noise in Masked Image Modeling Representations

Martine Hjelkrem-Tan, Marius Aasan, Rwiddhi Chakraborty +3

Masked Image Modeling (MIM) has become a ubiquitous self-supervised vision paradigm. In this work, we show that MIM objectives cause the learned representations to retain non-seman…