158 citations · 672 across the 57 of their papers we have counts for
7 papers · 1 filter
Detecting Adversarial Attacks On Audiovisual Speech Recognition
Pingchuan Ma, Stavros Petridis, Maja Pantic
Adversarial attacks pose a threat to deep learning models. However, research on adversarial detection methods, especially in the multi-modal domain, is very limited. In this work,…
Speech-driven facial animation using polynomial fusion of features
Triantafyllos Kefalas, Konstantinos Vougioukas, Yannis Panagakis +3
Speech-driven facial animation involves using a speech signal to generate realistic videos of talking faces. Recent deep learning approaches to facial synthesis rely on extracting…
Towards Pose-invariant Lip-Reading
Shiyang Cheng, Pingchuan Ma, Georgios Tzimiropoulos +4
Lip-reading models have been significantly improved recently thanks to powerful deep learning architectures. However, most works focused on frontal or near frontal views of the mou…
Investigating the Lombard Effect Influence on End-to-End Audio-Visual Speech Recognition
Pingchuan Ma, Stavros Petridis, Maja Pantic
Several audio-visual speech recognition models have been recently proposed which aim to improve the robustness over audio-only models in the presence of noise. However, almost all…
Realistic Speech-Driven Facial Animation with GANs
Konstantinos Vougioukas, Stavros Petridis, Maja Pantic
Speech-driven facial animation is the process that automatically synthesizes talking characters based on speech signals. The majority of work in this domain creates a mapping from…
Video-Driven Speech Reconstruction using Generative Adversarial Networks
Konstantinos Vougioukas, Pingchuan Ma, Stavros Petridis +1
Speech is a means of communication which relies on both audio and visual information. The absence of one modality can often lead to confusion or misinterpretation of information. I…
End-to-End Visual Speech Recognition for Small-Scale Datasets
Stavros Petridis, Yujiang Wang, Pingchuan Ma +2
Visual speech recognition models traditionally consist of two stages, feature extraction and classification. Several deep learning approaches have been recently presented aiming to…