2 citations · 2 across the 8 of their papers we have counts for
8 papers
Gelina: Unified Speech and Gesture Synthesis via Interleaved Token Prediction
Téo Guichoux, Théodor Lemerle, Shivam Mehta +5
Human communication is multimodal, with speech and gestures tightly coupled, yet most computational methods for generating speech and gestures synthesize them sequentially, weakeni…
Tailored Conversations beyond LLMs: A RL-Based Dialogue Manager
Lucie Galland, Catherine Pelachaud, Florian Pecune
In this work, we propose a novel framework that integrates large language models (LLMs) with an RL-based dialogue manager for open-ended dialogue with a specific goal. By leveragin…
2D or not 2D: How Does the Dimensionality of Gesture Representation Affect 3D Co-Speech Gesture Generation?
Téo Guichoux, Laure Soulier, Nicolas Obin +1
Co-speech gestures are fundamental for communication. The advent of recent deep learning techniques has facilitated the creation of lifelike, synchronous co-speech gestures for Emb…
EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations
Lucie Galland, Catherine Pelachaud, Florian Pecune
The study of multimodal interaction in therapy can yield a comprehensive understanding of therapist and patient behavior that can be used to develop a multimodal virtual agent supp…
Investigating the impact of 2D gesture representation on co-speech gesture generation
Teo Guichoux, Laure Soulier, Nicolas Obin +1
Co-speech gestures play a crucial role in the interactions between humans and embodied conversational agents (ECA). Recent deep learning methods enable the generation of realistic,…
META4: Semantically-Aligned Generation of Metaphoric Gestures Using Self-Supervised Text and Speech Representation
Mireille Fares, Catherine Pelachaud, Nicolas Obin
Image Schemas are repetitive cognitive patterns that influence the way we conceptualize and reason about various concepts present in speech. These patterns are deeply embedded with…
Seeing and hearing what has not been said; A multimodal client behavior classifier in Motivational Interviewing with interpretable fusion
Lucie Galland, Catherine Pelachaud, Florian Pecune
Motivational Interviewing (MI) is an approach to therapy that emphasizes collaboration and encourages behavioral change. To evaluate the quality of an MI conversation, client utter…
Is Two Better than One? Effects of Multiple Agents on User Persuasion
Reshmashree B. Kantharaju, Dominic De Franco, Alison Pease +1
Virtual humans need to be persuasive in order to promote behaviour change in human users. While several studies have focused on understanding the numerous aspects that influence th…