7 citations · 21 across the 8 of their papers we have counts for
3 papers · 1 filter
Backdoor Attacks on Vision Transformers
Akshayvarun Subramanya, Aniruddha Saha, Soroush Abbasi Koohpayegani +2
Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a sel…
SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation
K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar +1
Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform m…
A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision
Ajinkya Tejankar, Maziar Sanjabi, Bichen Wu +4
Using natural language as a supervision for training visual recognition models holds great promise. Recent works have shown that if such supervision is used in the form of alignmen…