178 citations · 193 across the 6 of their papers we have counts for
6 papers
Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence
Haoyu Zhang, Zhipeng Li, Xiaoying Tang +2
Omni-modal dialogue models can understand multimodal inputs and synthesize spoken replies, but a spoken answer still leaves the agent visually absent. We introduce \textbf{Ex-Omni-…
Towards Robust Multimodal Sentiment Analysis with Incomplete Data
Haoyu Zhang, Wenbin Wang, Tianshu Yu
The field of Multimodal Sentiment Analysis (MSA) has recently witnessed an emerging direction seeking to tackle the issue of data incompleteness. Recognizing that the language moda…
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis
Haoyu Zhang, Yu Wang, Guanghao Yin +3
Though Multimodal Sentiment Analysis (MSA) proves effective by utilizing rich information from multiple sources (e.g., language, video, and audio), the potential sentiment-irreleva…
A Hierarchical Destroy and Repair Approach for Solving Very Large-Scale Travelling Salesman Problem
Zhang-Hua Fu, Sipeng Sun, Jintong Ren +6
For prohibitively large-scale Travelling Salesman Problems (TSPs), existing algorithms face big challenges in terms of both computational efficiency and solution quality. To addres…
Noise-Resistant Multimodal Transformer for Emotion Recognition
Yuanyuan Liu, Haoyu Zhang, Yibing Zhan +4
Multimodal emotion recognition identifies human emotions from various data modalities like video, text, and audio. However, we found that this task can be easily affected by noisy…
Expression Snippet Transformer for Robust Video-based Facial Expression Recognition
Yuanyuan Liu, Wenbin Wang, Chuanxu Feng +3
The recent success of Transformer has provided a new direction to various visual understanding tasks, including video-based facial expression recognition (FER). By modeling visual…