activity
20152025
most citedTransformers in Vision: A Survey

3.6k citations · 4.8k across the 50 of their papers we have counts for

collaborators
Showing 2021Show all

10 papers · 1 filter

eess.IV2021★ 10 cited

A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation

Himashi Peiris, Munawar Hayat, Zhaolin Chen +2

We propose a Transformer architecture for volumetric segmentation, a challenging task that requires keeping a complex balance in encoding local and global spatial cues, and preserv…

cs.CV2021★ 195 cited

Restormer: Efficient Transformer for High-Resolution Image Restoration

Syed Waqas Zamir, Aditya Arora, Salman Khan +3

Since convolutional neural networks (CNNs) perform well at learning generalizable image priors from large-scale data, these models have been extensively applied to image restoratio…

cs.CV2021

MTGLS: Multi-Task Gaze Estimation with Limited Supervision

Shreya Ghosh, Munawar Hayat, Abhinav Dhall +1

Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and…

cs.CV2021★ 16 cited

Automatic Gaze Analysis: A Survey of Deep Learning based Approaches

Shreya Ghosh, Abhinav Dhall, Munawar Hayat +2

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze a…

cs.CV2021★ 305 cited

Intriguing Properties of Vision Transformers

Muzammal Naseer, Kanchana Ranasinghe, Salman Khan +3

Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can f…

cs.CV2021

Orthogonal Projection Loss

Kanchana Ranasinghe, Muzammal Naseer, Munawar Hayat +2

Deep neural networks have achieved remarkable performance on a range of classification tasks, with softmax cross-entropy (CE) loss emerging as the de-facto objective function. The…

cs.CV2021★ 54 cited

Multi-Stage Progressive Image Restoration

Syed Waqas Zamir, Aditya Arora, Salman Khan +4

Image restoration tasks demand a complex balance between spatial details and high-level contextualized information while recovering images. In this paper, we propose a novel synerg…

cs.CV2021

On Generating Transferable Targeted Perturbations

Muzammal Naseer, Salman Khan, Munawar Hayat +2

While the untargeted black-box transferability of adversarial perturbations has been extensively studied before, changing an unseen model's decisions to a specific `targeted' class…

cs.CV2021★ 5 cited

Low Light Image Enhancement via Global and Local Context Modeling

Aditya Arora, Muhammad Haris, Syed Waqas Zamir +4

Images captured under low-light conditions manifest poor visibility, lack contrast and color vividness. Compared to conventional approaches, deep convolutional neural networks (CNN…

cs.CV2021★ 3.6k cited

Transformers in Vision: A Survey

Salman Khan, Muzammal Naseer, Munawar Hayat +3

Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient…