Visual Representation Learning with Self-Supervised Attention for Low-Label High-data Regime

Prarthana Bhattacharyya, Chenge Li, Xiaonan Zhao +2

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have…