activity
20222026
most citedContextual Emotion Recognition using Large Vision Language Models

9 citations · 13 across the 8 of their papers we have counts for

collaborators

8 papers

cs.HC2026

How Neurotypical and Autistic Children Interact Nonverbally with Anthropomorphic Agents in Open-Ended Tasks

Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim +3

What nonverbal behaviors should a robot respond to? Understanding how children-both neurotypical and autistic-engage with embodied artificial agents is critical for developing incl…

cs.HC2025

React to This (RTT): A Nonverbal Turing Test for Embodied AI

Chuxuan Zhang, Yasaman Etesam, Angelica Lim

We propose an approach to test embodied AI agents for interaction awareness and believability, particularly in scenarios where humans push them to their limits. Turing introduced t…

cs.LG2025

CoMPAS3D: A Dataset and Benchmark for Interactive Motion

Bermet Burkanova, Yasaman Etesam, Payam Jome Yazdian +5

Socially interactive humanoid robots must engage with humans through their bodies, adapting in real time to a partner's movement, intent, and abilities. This requires models that u…

cs.HC2024

React to This! How Humans Challenge Interactive Agents using Nonverbal Behaviors

Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim +4

How do people use their faces and bodies to test the interactive abilities of a robot? Making lively, believable agents is often seen as a goal for robots and virtual agents but be…

cs.CV2024★ 9 cited

Contextual Emotion Recognition using Large Vision Language Models

Yasaman Etesam, Özge Nilay Yalçın, Chuxuan Zhang +1

"How does the person in the bounding box feel?" Achieving human-level recognition of the apparent emotion of a person in real world situations remains an unsolved task in computer…

cs.CV2023★ 1 cited

Emotional Theory of Mind: Bridging Fast Visual Processing with Slow Linguistic Reasoning

Yasaman Etesam, Özge Nilay Yalçın, Chuxuan Zhang +1

The emotional theory of mind problem requires facial expressions, body pose, contextual information and implicit commonsense knowledge to reason about the person's emotion and its…

cs.CV2023

Contextual Emotion Estimation from Image Captions

Vera Yang, Archita Srivastava, Yasaman Etesam +2

Emotion estimation in images is a challenging task, typically using computer vision methods to directly estimate people's emotions using face, body pose and contextual cues. In thi…

cs.RO2022★ 3 cited

Read the Room: Adapting a Robot's Voice to Ambient and Social Contexts

Paige Tuttosi, Emma Hughson, Akihiro Matsufuji +1

How should a robot speak in a formal, quiet and dark, or a bright, lively and noisy environment? By designing robots to speak in a more social and ambient-appropriate manner we can…