3.6k citations · 4.8k across the 50 of their papers we have counts for
47 papers · 1 filter
OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolation
Jisoo Jeong, Hong Cai, Risheek Garrepalli +3
The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on dat…
PosSAM: Panoptic Open-vocabulary Segment Anything
Vibashan VS, Shubhankar Borse, Hyojin Park +4
In this paper, we introduce an open-vocabulary panoptic segmentation model that effectively unifies the strengths of the Segment Anything Model (SAM) with the vision-language CLIP…
Unified Open-Vocabulary Dense Visual Prediction
Hengcan Shi, Munawar Hayat, Jianfei Cai
In recent years, open-vocabulary (OV) dense visual prediction (such as OV object detection, semantic, instance and panoptic segmentations) has attracted increasing research attenti…
Open-Vocabulary Object Detection via Scene Graph Discovery
Hengcan Shi, Munawar Hayat, Jianfei Cai
In recent years, open-vocabulary (OV) object detection has attracted increasing research attention. Unlike traditional detection, which only recognizes fixed-category objects, OV d…
Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization
Zhixi Cai, Shreya Ghosh, Abhinav Dhall +3
Most deepfake detection methods focus on detecting spatial and/or spatio-temporal changes in facial attributes and are centered around the binary classification task of detecting w…
Real-time Trajectory-based Social Group Detection
Simindokht Jahangard, Munawar Hayat, Hamid Rezatofighi
Social group detection is a crucial aspect of various robotic applications, including robot navigation and human-robot interactions. To date, a range of model-based techniques have…
ProtoCon: Pseudo-label Refinement via Online Clustering and Prototypical Consistency for Efficient Semi-supervised Learning
Islam Nassar, Munawar Hayat, Ehsan Abbasnejad +2
Confidence-based pseudo-labeling is among the dominant approaches in semi-supervised learning (SSL). It relies on including high-confidence predictions made on unlabeled data as ad…
MARLIN: Masked Autoencoder for facial video Representation LearnINg
Zhixi Cai, Shreya Ghosh, Kalin Stefanov +5
This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Att…
LAVA: Label-efficient Visual Learning and Adaptation
Islam Nassar, Munawar Hayat, Ehsan Abbasnejad +3
We present LAVA, a simple yet effective method for multi-domain visual transfer learning with limited data. LAVA builds on a few recent innovations to enable adapting to partially…
CLIP model is an Efficient Continual Learner
Vishal Thengane, Salman Khan, Munawar Hayat +1
The continual learning setting aims to learn new tasks over time without forgetting the previous ones. The literature reports several significant efforts to tackle this problem wit…
'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimation
Shreya Ghosh, Abhinav Dhall, Jarrod Knibbe +1
Over the past few years, there has been an increasing interest to interpret gaze direction in an unconstrained environment with limited supervision. Owing to data curation and anno…
AV-Gaze: A Study on the Effectiveness of Audio Guided Visual Attention Estimation for Non-Profilic Faces
Shreya Ghosh, Abhinav Dhall, Munawar Hayat +1
In challenging real-life conditions such as extreme head-pose, occlusions, and low-resolution images where the visual information fails to estimate visual attention/gaze direction,…
Transformer Scale Gate for Semantic Segmentation
Hengcan Shi, Munawar Hayat, Jianfei Cai
Effectively encoding multi-scale contextual information is crucial for accurate semantic segmentation. Existing transformer-based segmentation models combine features across scales…
NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results
Yawei Li, Kai Zhang, Radu Timofte +108
This paper reviews the NTIRE 2022 challenge on efficient single image super-resolution with focus on the proposed solutions and results. The task of the challenge was to super-reso…
Semantic-Aware Domain Generalized Segmentation
Duo Peng, Yinjie Lei, Munawar Hayat +2
Deep models trained on source domain lack generalization when evaluated on unseen target domains with different data distributions. The problem becomes even more pronounced when we…
Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization
Zhixi Cai, Kalin Stefanov, Abhinav Dhall +1
Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attribute…
Deformation and Correspondence Aware Unsupervised Synthetic-to-Real Scene Flow Estimation for Point Clouds
Zhao Jin, Yinjie Lei, Naveed Akhtar +2
Point cloud scene flow estimation is of practical importance for dynamic scene navigation in autonomous driving. Since scene flow labels are hard to obtain, current methods train t…
ProposalCLIP: Unsupervised Open-Category Object Proposal Generation via Exploiting CLIP Cues
Hengcan Shi, Munawar Hayat, Yicheng Wu +1
Object proposal generation is an important and fundamental task in computer vision. In this paper, we propose ProposalCLIP, a method towards unsupervised open-category object propo…
Unpaired Referring Expression Grounding via Bidirectional Cross-Modal Matching
Hengcan Shi, Munawar Hayat, Jianfei Cai
Referring expression grounding is an important and challenging task in computer vision. To avoid the laborious annotation in conventional referring grounding, unpaired referring gr…
Restormer: Efficient Transformer for High-Resolution Image Restoration
Syed Waqas Zamir, Aditya Arora, Salman Khan +3
Since convolutional neural networks (CNNs) perform well at learning generalizable image priors from large-scale data, these models have been extensively applied to image restoratio…
MTGLS: Multi-Task Gaze Estimation with Limited Supervision
Shreya Ghosh, Munawar Hayat, Abhinav Dhall +1
Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and…
Automatic Gaze Analysis: A Survey of Deep Learning based Approaches
Shreya Ghosh, Abhinav Dhall, Munawar Hayat +2
Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze a…
Intriguing Properties of Vision Transformers
Muzammal Naseer, Kanchana Ranasinghe, Salman Khan +3
Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can f…
Orthogonal Projection Loss
Kanchana Ranasinghe, Muzammal Naseer, Munawar Hayat +2
Deep neural networks have achieved remarkable performance on a range of classification tasks, with softmax cross-entropy (CE) loss emerging as the de-facto objective function. The…