305 citations · 357 across the 27 of their papers we have counts for
4 papers · 1 filter
Self-supervised Video Transformer
Kanchana Ranasinghe, Muzammal Naseer, Salman Khan +2
In this paper, we propose self-supervised training for video transformers using unlabeled video data. From a given video, we create local and global spatiotemporal views with varyi…
On Improving Adversarial Transferability of Vision Transformers
Muzammal Naseer, Kanchana Ranasinghe, Salman Khan +2
Vision transformers (ViTs) process input images as sequences of patches via self-attention; a radically different architecture than convolutional neural networks (CNNs). This makes…
Intriguing Properties of Vision Transformers
Muzammal Naseer, Kanchana Ranasinghe, Salman Khan +3
Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can f…
Orthogonal Projection Loss
Kanchana Ranasinghe, Muzammal Naseer, Munawar Hayat +2
Deep neural networks have achieved remarkable performance on a range of classification tasks, with softmax cross-entropy (CE) loss emerging as the de-facto objective function. The…