8 papers
MyoSem: Aligning Electromyography to Natural-Language Action Semantics for Hand Action Understanding
Chiyue Wang, Dong She, Yang Gao +1
Electromyography (EMG) directly reflects muscle activation and is a key sensing modality for gesture recognition, prosthetic control, and wearable interaction. Existing EMG methods…
MindMelody: A Closed-Loop EEG-Driven System for Personalized Music Intervention
Yimeng Zhang, Yueru Sun, Haoyu Gu +1
Driven by the escalating global burden of mental health conditions, music-based interventions have attracted significant attention as a non-invasive, cost-effective modality for em…
EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingness
Yueru Sun, Yimeng Zhang, Haoyu Gu +5
Multimodal Emotion Recognition (MER) is critical for interpreting real-world interactions. While Multimodal Large Language Models (MLLM) have shown promise in MER, their internal d…
Persona-E: A Human-Grounded Dataset for Personality-Shaped Emotional Responses to Textual Events
Yuqin Yang, Haowu Zhou, Haoran Tu +7
Most affective computing research treats emotion as a static property of text, focusing on the writer's sentiment while overlooking the reader's perspective. This approach ignores…
AICA-Bench: Holistically Examining the Capabilities of VLMs in Affective Image Content Analysis
Dong She, Xianrong Yao, Liqun Chen +3
Vision-Language Models (VLMs) have demonstrated strong capabilities in perception, yet holistic Affective Image Content Analysis (AICA), which integrates perception, reasoning, and…
IMUFace: Towards Always-On 3D Facial Reconstruction via Earphone Inertial Sensing
Xianrong Yao, Lingde Hu, Dong She +3
The potential of facial expression reconstruction technology is significant, with applications in various fields such as human-computer interaction, affective computing, and virtua…