850 citations · 1k across the 14 of their papers we have counts for
6 papers · 1 filter
Compressing Video Calls using Synthetic Talking Heads
Madhav Agarwal, Anchit Gupta, Rudrabha Mukhopadhyay +2
We leverage the modern advancements in talking head generation to propose an end-to-end system for talking head video compression. Our algorithm transmits pivot frames intermittent…
Site Split of Antiferromagnetic -Mn Revealed by Mn Nuclear Magnetic Resonance
Masahiro Manago, Gaku Motoyama, Shijo Nishigori +8
The magnetic structure of antiferromagnetic -Mn has been unclarified for almost 70 years since its magnetism was discovered. We measured the zero-field nuclear magnetic resonanc…
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild
Sindhu B Hegde, K R Prajwal, Rudrabha Mukhopadhyay +2
In this work, we address the problem of generating speech from silent lip videos for any speaker in the wild. In stark contrast to previous works, our method (i) is not restricted…
Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors
Sindhu B Hegde, Rudrabha Mukhopadhyay, Vinay P Namboodiri +1
In this paper, we explore an interesting question of what can be obtained from an pixel video sequence. Surprisingly, it turns out to be quite a lot. We show that when w…
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or improve one's lipreading sk…
FaceOff: A Video-to-Video Face Swapping System
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays multiple characters. The…