Understanding Masked Autoencoders From a Local Contrastive Perspective

Xiaoyu Yue, Lei Bai, Meng Wei +4

Masked AutoEncoder (MAE) has revolutionized the field of self-supervised learning with its simple yet effective masking and reconstruction strategies. However, despite achieving st…