8 citations · 30 across the 13 of their papers we have counts for
3 papers · 2 filters
Backdoor Attacks on Vision Transformers
Akshayvarun Subramanya, Aniruddha Saha, Soroush Abbasi Koohpayegani +2
Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a sel…
SimA: Simple Softmax-free Attention for Vision Transformers
Soroush Abbasi Koohpayegani, Hamed Pirsiavash
Recently, vision transformers have become very popular. However, deploying them in many applications is computationally expensive partly due to the Softmax layer in the attention b…
SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation
K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar +1
Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform m…