850 citations · 1k across the 14 of their papers we have counts for
15 papers
When Teachers Smile or Frown: A Profile-Based Analysis of Achievement Emotions
Rudra Mukhopadhyay, Satyaki Mazumder, Koel Das
Achievement emotions shape how students engage with and learn from academic tasks, yet most studies examine individual emotions rather than co-occurring affective profiles and thei…
Towards Accurate Lip-to-Speech Synthesis in-the-Wild
Sindhu Hegde, Rudrabha Mukhopadhyay, C. V. Jawahar +1
In this paper, we introduce a novel approach to address the task of synthesizing speech from silent videos of any in-the-wild speaker solely based on lip movements. The traditional…
Compressing Video Calls using Synthetic Talking Heads
Madhav Agarwal, Anchit Gupta, Rudrabha Mukhopadhyay +2
We leverage the modern advancements in talking head generation to propose an end-to-end system for talking head video compression. Our algorithm transmits pivot frames intermittent…
Site Split of Antiferromagnetic -Mn Revealed by Mn Nuclear Magnetic Resonance
Masahiro Manago, Gaku Motoyama, Shijo Nishigori +8
The magnetic structure of antiferromagnetic -Mn has been unclarified for almost 70 years since its magnetism was discovered. We measured the zero-field nuclear magnetic resonanc…
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild
Sindhu B Hegde, K R Prajwal, Rudrabha Mukhopadhyay +2
In this work, we address the problem of generating speech from silent lip videos for any speaker in the wild. In stark contrast to previous works, our method (i) is not restricted…
Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors
Sindhu B Hegde, Rudrabha Mukhopadhyay, Vinay P Namboodiri +1
In this paper, we explore an interesting question of what can be obtained from an pixel video sequence. Surprisingly, it turns out to be quite a lot. We show that when w…
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or improve one's lipreading sk…
FaceOff: A Video-to-Video Face Swapping System
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays multiple characters. The…
Personalized One-Shot Lipreading for an ALS Patient
Bipasha Sen, Aditya Agarwal, Rudrabha Mukhopadhyay +2
Lipreading or visually recognizing speech from the mouth movements of a speaker is a challenging and mentally taxing task. Unfortunately, multiple medical conditions force people t…
Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor
Anchit Gupta, Faizan Farooq Khan, Rudrabha Mukhopadhyay +2
This paper proposes a video editor based on OpenShot with several state-of-the-art facial video editing algorithms as added functionalities. Our editor provides an easy-to-use inte…
Towards Automatic Speech to Sign Language Generation
Parul Kapoor, Rudrabha Mukhopadhyay, Sindhu B Hegde +2
We aim to solve the highly challenging task of generating continuous sign language videos solely from speech segments for the first time. Recent efforts in this space have focused…
Visual Speech Enhancement Without A Real Visual Stream
Sindhu B Hegde, K R Prajwal, Rudrabha Mukhopadhyay +2
In this work, we re-think the task of speech enhancement in unconstrained real-world environments. Current state-of-the-art methods use only the audio stream and are limited in the…
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild
K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri +1
In this work, we investigate the problem of lip-syncing a talking face video of an arbitrary identity to match a target speech segment. Current works excel at producing accurate li…
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri +1
Humans involuntarily tend to infer parts of the conversation from lip movements when the speech is absent or corrupted by external noise. In this work, we explore the task of lip t…
Towards Automatic Face-to-Face Translation
Prajwal K R, Rudrabha Mukhopadhyay, Jerin Philip +3
In light of the recent breakthroughs in automatic machine translation systems, we propose a novel approach that we term as "Face-to-Face Translation". As today's digital communicat…