PatchRot: A Self-Supervised Technique for Training Vision Transformers

Sachin Chhabra, Prabal Bijoy Dutta, Hemanth Venkateswara +1

Vision transformers require a huge amount of labeled data to outperform convolutional neural networks. However, labeling a huge dataset is a very expensive process. Self-supervised…