Masked autoencoders are effective solution to transformer data-hungry

Jiawei Mao, Honggu Zhou, Xuesong Yin +1

Vision Transformers (ViTs) outperforms convolutional neural networks (CNNs) in several vision tasks with its global modeling capabilities. However, ViT lacks the inductive bias inh…