205 citations · 335 across the 39 of their papers we have counts for
5 papers · 1 filter
Neural Voice Puppetry: Audio-driven Facial Reenactment
Justus Thies, Mohamed Elgharib, Ayush Tewari +2
We present Neural Voice Puppetry, a novel approach for audio-driven facial video synthesis. Given an audio sequence of a source person or digital assistant, we generate a photo-rea…
3D Morphable Face Models -- Past, Present and Future
Bernhard Egger, William A. P. Smith, Ayush Tewari +10
In this paper, we provide a detailed survey of 3D Morphable Face Models over the 20 years since they were first proposed. The challenges in building and applying these models, name…
Text-based Editing of Talking-head Video
Ohad Fried, Ayush Tewari, Michael Zollhöfer +7
Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to pr…
EgoFace: Egocentric Face Performance Capture and Videorealistic Reenactment
Mohamed Elgharib, Mallikarjun BR, Ayush Tewari +4
Face performance capture and reenactment techniques use multiple cameras and sensors, positioned at a distance from the face or mounted on heavy wearable devices. This limits their…
DEMEA: Deep Mesh Autoencoders for Non-Rigidly Deforming Objects
Edgar Tretschk, Ayush Tewari, Michael Zollhöfer +2
Mesh autoencoders are commonly used for dimensionality reduction, sampling and mesh modeling. We propose a general-purpose DEep MEsh Autoencoder (DEMEA) which adds a novel embedded…