5 papers
Do Visual Features Improve Other-Initiated Repair Detection? A Dyadic Multimodal Approach
Anh Ngo, Nicolas Rollet, Catherine Pelachaud +1
Other-initiated Self-repair, or in short Other-initiated Repair (OIR), is an essential mechanism in conversational interaction, whereby a recipient signals a problem in speaking, h…
Breaking Players' expectations: the Role of Non-player Characters' coherence and Consistency
Remi Poivet, Catherine Pelachaud, Malika Auvray
In video games, non-player characters (NPCs) play a pivotal role in shaping players' experiences. The design of these characters, encompassing their appearance and behaviors, can b…
"Mm, Wat?" Detecting Other-initiated Repair Requests in Dialogue
Anh Ngo, Nicolas Rollet, Catherine Pelachaud +1
Maintaining mutual understanding is a key component in human-human conversation to avoid conversation breakdowns, in which repair, particularly Other-Initiated Repair (OIR, when on…
Voice Activity Projection Model with Multimodal Encoders
Takeshi Saga, Catherine Pelachaud
Turn-taking management is crucial for any social interaction. Still, it is challenging to model human-machine interaction due to the complexity of the social context and its multim…
GRETA: Modular Platform to Create Adaptive Socially Interactive Agents
Michele Grimaldi, Jieyeon Woo, Fabien Boucaud +7
The interaction between humans is very complex to describe since it is composed of different elements from different modalities such as speech, gaze, and gestures influenced by soc…