4 papers
SEREP: Semantic Facial Expression Representation for Robust In-the-Wild Capture and Retargeting
Arthur Josi, Luiz Gustavo Hafemann, Abdallah Dib +3
Monocular facial performance capture in-the-wild is challenging due to varied capture conditions, face shapes, and expressions. Most current methods rely on linear 3D Morphable Mod…
Analyzing and Improving Speaker Similarity Assessment for Speech Synthesis
Marc-André Carbonneau, Benjamin van Niekerk, Hugo Seuté +3
Modeling voice identity is challenging due to its multifaceted nature. In generative speech systems, identity is often assessed using automatic speaker verification (ASV) embedding…
LinearVC: Linear transformations of self-supervised features through the lens of voice conversion
Herman Kamper, Benjamin van Niekerk, Julian Zaïdi +1
We introduce LinearVC, a simple voice conversion method that sheds light on the structure of self-supervised representations. First, we show that simple linear transformations of s…
Geometry-Aware Texture Generation for 3D Head Modeling with Artist-driven Control
Amin Fadaeinejad, Abdallah Dib, Luiz Gustavo Hafemann +6
Creating realistic 3D head assets for virtual characters that match a precise artistic vision remains labor-intensive. We present a novel framework that streamlines this process by…