45 citations · 218 across the 33 of their papers we have counts for
8 papers · 1 filter
Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss
Shailza Sharma, Abhinav Dhall, Vinay Kumar +1
Recently, there has been numerous breakthroughs in face hallucination tasks. However, the task remains rather challenging in videos in comparison to the images due to inherent cons…
MARLIN: Masked Autoencoder for facial video Representation LearnINg
Zhixi Cai, Shreya Ghosh, Kalin Stefanov +5
This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Att…
Neural Encoding of Songs is Modulated by Their Enjoyment
Gulshan Sharma, Pankaj Pandey, Ramanathan Subramanian +2
We examine user and song identification from neural (EEG) signals. Owing to perceptual subjectivity in human-media interaction, music identification from brain signals is a challen…
'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimation
Shreya Ghosh, Abhinav Dhall, Jarrod Knibbe +1
Over the past few years, there has been an increasing interest to interpret gaze direction in an unconstrained environment with limited supervision. Owing to data curation and anno…
AV-Gaze: A Study on the Effectiveness of Audio Guided Visual Attention Estimation for Non-Profilic Faces
Shreya Ghosh, Abhinav Dhall, Munawar Hayat +1
In challenging real-life conditions such as extreme head-pose, occlusions, and low-resolution images where the visual information fails to estimate visual attention/gaze direction,…
RAZE: Region Guided Self-Supervised Gaze Representation Learning
Neeru Dubey, Shreya Ghosh, Abhinav Dhall
Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality an…