17 citations · 44 across the 11 of their papers we have counts for
12 papers
Drawing the Line: Where AI Guidance and Human Creativity Meet in Emotion-Driven Comic Storyboarding
Jocelyn Shen, Isabella Pu, Alessandro Briseño +5
While generative AI models can produce visually faithful artwork, they often fall short in conveying emotional authenticity--a key driver of human expression. In visual storytellin…
Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis
Felipe Moreno, Sharifa Alghowinem, Hae Won Park +1
Given the widespread prevalence of depression and its consequential impact on individuals and society, it is crucial to obtain objective measures for early diagnosis and interventi…
Ensembling Large Language Models to Characterize Affective Dynamics in Student-AI Tutor Dialogues
Chenyu Zhang, Sharifa Alghowinem, Cynthia Breazeal
While recent studies have examined the leaning impact of large language model (LLM) in educational contexts, the affective dynamics of LLM-mediated tutoring remain insufficiently u…
Social Robots as Social Proxies for Fostering Connection and Empathy Towards Humanity
Jocelyn Shen, Audrey Lee, Sharifa Alghowinem +3
Despite living in an increasingly connected world, social isolation is a prevalent issue today. While social robots have been explored as tools to enhance social connection through…
A HeARTfelt Robot: Social Robot-Driven Deep Emotional Art Reflection with Children
Isabella Pu, Golda Nguyen, Lama Alsultan +3
Social-emotional learning (SEL) skills are essential for children to develop to provide a foundation for future relational and academic success. Using art as a medium for creation…
EmpathicStories++: A Multimodal Dataset for Empathy towards Personal Experiences
Jocelyn Shen, Yubin Kim, Mohit Hulse +4
Modeling empathy is a complex endeavor that is rooted in interpersonal and experiential dimensions of human interaction, and remains an open problem within AI. Existing empathy dat…
Integrating Flow Theory and Adaptive Robot Roles: A Conceptual Model of Dynamic Robot Role Adaptation for the Enhanced Flow Experience in Long-term Multi-person Human-Robot Interactions
Huili Chen, Sharifa Alghowinem, Cynthia Breazeal +1
In this paper, we introduce a novel conceptual model for a robot's behavioral adaptation in its long-term interaction with humans, integrating dynamic robot role adaptation with pr…
HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with Cross-person Memory Transformer
Yubin Kim, Dong Won Lee, Paul Pu Liang +3
Accurately modeling affect dynamics, which refers to the changes and fluctuations in emotions and affective displays during human conversations, is crucial for understanding human…
Joint Engagement Classification using Video Augmentation Techniques for Multi-person Human-robot Interaction
Yubin Kim, Huili Chen, Sharifa Alghowinem +2
Affect understanding capability is essential for social robots to autonomously interact with a group of users in an intuitive and reciprocal way. However, the challenge of multi-pe…
Build-a-Bot: Teaching Conversational AI Using a Transformer-Based Intent Recognition and Question Answering Architecture
Kate Pearce, Sharifa Alghowinem, Cynthia Breazeal
As artificial intelligence (AI) becomes a prominent part of modern life, AI literacy is becoming important for all citizens, not just those in technology careers. Previous research…
Explainable AI for Suicide Risk Assessment Using Eye Activities and Head Gestures
Siyu Liu, Catherine Lu, Sharifa Alghowinem +3
The prevalence of suicide has been on the rise since the 20th century, causing severe emotional damage to individuals, families, and communities alike. Despite the severity of this…
A Robotic Positive Psychology Coach to Improve College Students' Wellbeing
Sooyeon Jeong, Sharifa Alghowinem, Laura Aymerich-Franch +5
A significant number of college students suffer from mental health issues that impact their physical, social, and occupational outcomes. Various scalable technologies have been pro…