Improving Masked Autoencoders by Learning Where to Mask

Haijian Chen, Wendong Zhang, Yunbo Wang +1

Masked image modeling is a promising self-supervised learning method for visual data. It is typically built upon image patches with random masks, which largely ignores the variatio…