On the Surprising Effectiveness of Transformers in Low-Labeled Video Recognition

Farrukh Rahman, Ömer Mubarek, Zsolt Kira

Recently vision transformers have been shown to be competitive with convolution-based methods (CNNs) broadly across multiple vision tasks. The less restrictive inductive bias of tr…