Effective Vision Transformer Training: A Data-Centric Perspective

Benjia Zhou, Pichao Wang, Jun Wan +2

Vision Transformers (ViTs) have shown promising performance compared with Convolutional Neural Networks (CNNs), but the training of ViTs is much harder than CNNs. In this paper, we…