11 papers
MyoSem: Aligning Electromyography with Natural-Language Action Semantics
Chiyue Wang, Dong She, Yang Gao +1
Electromyography (EMG) records muscle activation for hand gesture recognition, prosthetic control, and wearable interaction. Existing EMG methods usually formulate hand action unde…
EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingness
Yueru Sun, Yimeng Zhang, Haoyu Gu +5
Multimodal Emotion Recognition (MER) is critical for interpreting real-world interactions. While Multimodal Large Language Models (MLLM) have shown promise in MER, their internal d…
Persona-E: A Human-Grounded Dataset for Personality-Shaped Emotional Responses to Textual Events
Yuqin Yang, Haowu Zhou, Haoran Tu +7
Most affective computing research treats emotion as a static property of text, focusing on the writer's sentiment while overlooking the reader's perspective. This approach ignores…
AICA-Bench: Holistically Examining the Capabilities of VLMs in Affective Image Content Analysis
Dong She, Xianrong Yao, Liqun Chen +3
Vision-Language Models (VLMs) have demonstrated strong capabilities in perception, yet holistic Affective Image Content Analysis (AICA), which integrates perception, reasoning, and…
Empathy-R1: A Chain-of-Empathy and Reinforcement Learning Framework for Long-Form Mental Health Support
Xianrong Yao, Dong She, Chenxu Zhang +5
Empathy is critical for effective mental health support, especially when addressing Long Counseling Texts (LCTs). However, existing Large Language Models (LLMs) often generate repl…
MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglement
Dong She, Siming Fu, Mushui Liu +4
Multi-subject personalized generation presents unique challenges in maintaining identity fidelity and semantic coherence when synthesizing images conditioned on multiple reference…
FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus
Qiaoqiao Jin, Siming Fu, Dong She +4
Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving…
CMMCoT: Enhancing Complex Multi-Image Comprehension via Multi-Modal Chain-of-Thought and Memory Augmentation
Guanghao Zhang, Tao Zhong, Yan Xia +8
While previous multimodal slow-thinking methods have demonstrated remarkable success in single-image understanding scenarios, their effectiveness becomes fundamentally constrained…
Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models
Yi Wang, Mushui Liu, Wanggui He +13
Unified generative models have shown remarkable performance in text and image generation. For image synthesis tasks, they adopt straightforward text-to-image (T2I) generation. Howe…
CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformers
D. She, Mushui Liu, Jingxuan Pang +9
Customized generation has achieved significant progress in image synthesis, yet personalized video generation remains challenging due to temporal inconsistencies and quality degrad…
IMUFace: Towards Always-On 3D Facial Reconstruction via Earphone Inertial Sensing
Xianrong Yao, Lingde Hu, Dong She +3
The potential of facial expression reconstruction technology is significant, with applications in various fields such as human-computer interaction, affective computing, and virtua…