Show Me Your Face, And I'll Tell You How You Speak

Christen Millerdurai, Lotfy Abdel Khaliq, Timon Ulrich

When we speak, the prosody and content of the speech can be inferred from the movement of our lips. In this work, we explore the task of lip to speech synthesis, i.e., learning to…