6 papers
SemConFlow: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching
Lanmiao Liu, Esam Ghaleb, Aslı Ãzyürek +1
While the field of co-speech gesture generation has seen significant advances, producing holistic, semantically grounded gestures remains a challenge. Existing approaches rely on e…
Deploying Speech-Driven 3D Facial Animation in Unreal Engine for Production-Ready Digital Humans
Alessandro Busacchi, Kazi Injamamul Haque, Zerrin Yumak
Speech-driven 3D facial animation research has shown promising results, but most methods rely on representations that are not compatible with production pipelines. In this work, we…
Effect of Appearance and Animation Realism on the Perception of Emotionally Expressive Virtual Humans
Nabila Amadou, Kazi Injamamul Haque, Zerrin Yumak
3D Virtual Human technology is growing with several potential applications in health, education, business and telecommunications. Investigating the perception of these virtual huma…
"I don't like my avatar": Investigating Human Digital Doubles
Siyi Liu, Kazi Injamamul Haque, Zerrin Yumak
Creating human digital doubles is becoming easier and much more accessible to everyone using consumer grade devices. In this work, we investigate how avatar style (realistic vs car…
SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning
Lanmiao Liu, Esam Ghaleb, Aslı Ãzyürek +1
Creating a virtual avatar with semantically coherent gestures that are aligned with speech is a challenging task. Existing gesture generation research mainly focused on generating…
ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE
Sichun Wu, Kazi Injamamul Haque, Zerrin Yumak
Audio-driven 3D facial animation synthesis has been an active field of research with attention from both academia and industry. While there are promising results in this area, rece…