Learning to Dub Movies via Hierarchical Prosody Models

Gaoxiang Cong, Liang Li, Yuankai Qi +6

Given a piece of text, a video clip and a reference audio, the movie dubbing (also known as visual voice clone V2C) task aims to generate speeches that match the speaker's emotion…