301 citations · 1k across the 20 of their papers we have counts for
4 papers · 1 filter
SPACE: Speech-driven Portrait Animation with Controllable Expression
Siddharth Gururani, Arun Mallya, Ting-Chun Wang +2
Animating portraits using speech has received growing attention in recent years, with various creative and practical use cases. An ideal generated video should have good lip sync w…
Implicit Warping for Animation with Image Sets
Arun Mallya, Ting-Chun Wang, Ming-Yu Liu
We present a new implicit warping framework for image animation using sets of source images through the transfer of the motion of a driving video. A single cross- modal attention l…
Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation
Yu-Ying Yeh, Koki Nagano, Sameh Khamis +3
Given a portrait image of a person and an environment map of the target lighting, portrait relighting aims to re-illuminate the person in the image as if the person appeared in an…
Generating Long Videos of Dynamic Scenes
Tim Brooks, Janne Hellsten, Miika Aittala +6
We present a video generation model that accurately reproduces object motion, changes in camera viewpoint, and new content that arises over time. Existing video generation methods…