19 citations · 57 across the 7 of their papers we have counts for
11 papers
Fake it to make it: Using synthetic data to remedy the data shortage in joint multimodal speech-and-gesture synthesis
Shivam Mehta, Anna Deichler, Jim O'Regan +4
Although humans engaged in face-to-face conversation simultaneously communicate both verbally and non-verbally, methods for joint and unified synthesis of speech audio and co-speec…
Mechanical Chameleons: Evaluating the effects of a social robot's non-verbal behavior on social influence
Patrik Jonell, Anna Deichler, Ilaria Torre +2
In this paper we present a pilot study which investigates how non-verbal behavior affects social influence in social robots. We also present a modular system which is capable of co…
Integrated Speech and Gesture Synthesis
Siyang Wang, Simon Alexanderson, Joakim Gustafson +3
Text-to-speech and co-speech gesture synthesis have until now been treated as separate areas by two different research communities, and applications merely stack the two technologi…
Generating coherent spontaneous speech and gesture from text
Simon Alexanderson, Éva Székely, Gustav Eje Henter +2
Embodied human communication encompasses both verbal (speech) and non-verbal information (e.g., gesture and head movements). Recent advances in machine learning have substantially…
Can we trust online crowdworkers? Comparing online and offline participants in a preference test of virtual agents
Patrik Jonell, Taras Kucherenko, Ilaria Torre +1
Conducting user studies is a crucial component in many scientific fields. While some studies require participants to be physically present, other studies can be conducted both phys…
Let's Face It: Probabilistic Multi-modal Interlocutor-aware Generation of Facial Gestures in Dyadic Settings
Patrik Jonell, Taras Kucherenko, Gustav Eje Henter +1
To enable more natural face-to-face interactions, conversational agents need to adapt their behavior to their interlocutors. One key aspect of this is generation of appropriate non…