3 citations · 11 across the 9 of their papers we have counts for
9 papers
TranSTYLer: Multimodal Behavioral Style Transfer for Facial and Body Gestures Generation
Mireille Fares, Catherine Pelachaud, Nicolas Obin
This paper addresses the challenge of transferring the behavior expressivity style of a virtual agent to another one while preserving behaviors shape as they carry communicative me…
ZS-MSTM: Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding
Mireille Fares, Catherine Pelachaud, Nicolas Obin
In this study, we address the importance of modeling behavior style in virtual agents for personalized human-agent interaction. We propose a machine learning approach to synthesize…
AMII: Adaptive Multimodal Inter-personal and Intra-personal Model for Adapted Behavior Synthesis
Jieyeon Woo, Mireille Fares, Catherine Pelachaud +1
Socially Interactive Agents (SIAs) are physical or virtual embodied agents that display similar behavior as human multimodal behavior. Modeling SIAs' non-verbal behavior, such as s…
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding
Mireille Fares, Michele Grimaldi, Catherine Pelachaud +1
Modeling virtual agents with behavior style is one factor for personalizing human agent interaction. We propose an efficient yet effective machine learning approach to synthesize g…
Representation Learning of Image Schema
Fajrian Yunus, Chloé Clavel, Catherine Pelachaud
Image schema is a recurrent pattern of reasoning where one entity is mapped into another. Image schema is similar to conceptual metaphor and is also related to metaphoric gesture.…
Transformer Network for Semantically-Aware and Speech-Driven Upper-Face Generation
Mireille Fares, Catherine Pelachaud, Nicolas Obin
We propose a semantically-aware speech driven model to generate expressive and natural upper-facial and head motion for Embodied Conversational Agents (ECA). In this work, we aim t…
Sequence-to-Sequence Predictive Model: From Prosody To Communicative Gestures
Fajrian Yunus, Chloé Clavel, Catherine Pelachaud
Communicative gestures and speech acoustic are tightly linked. Our objective is to predict the timing of gestures according to the acoustic. That is, we want to predict when a cert…
Emergence of synchrony in an Adaptive Interaction Model
Kevin Sanlaville, Gérard Assayag, Frédéric Bevilacqua +1
In a Human-Computer Interaction context, we aim to elaborate an adaptive and generic interaction model in two different use cases: Embodied Conversational Agents and Creative Music…
Expressing social attitudes in virtual agents for social training games
Nicolas Sabouret, Hazaël Jones, Magalie Ochs +2
The use of virtual agents in social coaching has increased rapidly in the last decade. In order to train the user in different situations than can occur in real life, the virtual a…