ViT-P: Rethinking Data-efficient Vision Transformers from Locality

Bin Chen, Ran Wang, Di Ming +1

Recent advances of Transformers have brought new trust to computer vision tasks. However, on small dataset, Transformers is hard to train and has lower performance than convolution…