4 papers
From Tokens to Faces: Investigating Discrete Speech Representations for 3D Facial Animation
Pedro Correa, Olivier Perrotin, Samir Sadok +2
The choice of speech representation is critical in speech-driven 3D facial animation. Representations differ in what they encode: SSL features emphasize segmental and semantic cues…
Speak Your Mind: The Speech Continuation Task as a Probe of Voice-Based Model Bias
Shree Harsha Bokkahalli Satish, Harm Lameris, Olivier Perrotin +2
Speech Continuation (SC) is the task of generating a coherent extension of a spoken prompt while preserving both semantic context and speaker identity. Because SC is constrained to…
Is Self-Supervised Learning Enough to Fill in the Gap? A Study on Speech Inpainting
Ihab Asaad, Maxime Jacquelin, Olivier Perrotin +2
Speech inpainting consists in reconstructing corrupted or missing speech segments using surrounding context, a process that closely resembles the pretext tasks in Self-Supervised L…
Investigating the dynamics of hand and lips in French Cued Speech using attention mechanisms and CTC-based decoding
Sanjana Sankar, Denis Beautemps, Frédéric Elisei +2
Hard of hearing or profoundly deaf people make use of cued speech (CS) as a communication tool to understand spoken language. By delivering cues that are relevant to the phonetic i…