End to End Lip Synchronization with a Temporal AutoEncoder

Yoav Shalev, Lior Wolf

We study the problem of syncing the lip movement in a video with the audio stream. Our solution finds an optimal alignment using a dual-domain recurrent neural network that is trai…