6 papers
CoMPAS3D: A Dataset and Benchmark for Interactive Motion
Bermet Burkanova, Yasaman Etesam, Payam Jome Yazdian +5
Socially interactive humanoid robots must engage with humans through their bodies, adapting in real time to a partner's movement, intent, and abilities. This requires models that u…
How Neurotypical and Autistic Children Interact Nonverbally with Anthropomorphic Agents in Open-Ended Tasks
Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim +3
What nonverbal behaviors should a robot respond to? Understanding how children-both neurotypical and autistic-engage with embodied artificial agents is critical for developing incl…
React to This (RTT): A Nonverbal Turing Test for Embodied AI
Chuxuan Zhang, Yasaman Etesam, Angelica Lim
We propose an approach to test embodied AI agents for interaction awareness and believability, particularly in scenarios where humans push them to their limits. Turing introduced t…
Contextual Emotion Recognition using Large Vision Language Models
Yasaman Etesam, Ãzge Nilay Yalçın, Chuxuan Zhang +1
"How does the person in the bounding box feel?" Achieving human-level recognition of the apparent emotion of a person in real world situations remains an unsolved task in computer…
React to This! How Humans Challenge Interactive Agents using Nonverbal Behaviors
Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim +4
How do people use their faces and bodies to test the interactive abilities of a robot? Making lively, believable agents is often seen as a goal for robots and virtual agents but be…
Emotional Theory of Mind: Bridging Fast Visual Processing with Slow Linguistic Reasoning
Yasaman Etesam, Ãzge Nilay Yalçın, Chuxuan Zhang +1
The emotional theory of mind problem requires facial expressions, body pose, contextual information and implicit commonsense knowledge to reason about the person's emotion and its…