12 citations · 24 across the 7 of their papers we have counts for
8 papers
ContraSafe-VL: A Contrastive Safety Preference Dataset for Vision-Language Models
Di Wu, Yanyan Zhao, Xin Lu +3
Vision-Language Models (VLMs) are increasingly deployed as general-purpose multimodal assistants, making multimodal safety alignment an important challenge. Safety depends on the i…
InCarEmo: A Multimodal Dataset for In-Cabin Emotion Recognition and Driver State Monitoring
Hao Yang, Yanyan Zhao, Kewei Zhao +11
Understanding driver emotion and state is critical for the next generation of intelligent in-cabin systems that ensure safety and enhance human-vehicle interaction. However, existi…
DeepSight: Bridging Depth Maps and Language with a Depth-Driven Multimodal Model
Hao Yang, Hongbo Zhang, Yanyan Zhao +1
Multimodal large language models (MLLMs) have achieved impressive performance across various tasks such as image captioning and visual question answer(VQA); however, they often str…
Text-Driven Emotionally Continuous Talking Face Generation
Hao Yang, Yanyan Zhao, Tian Zheng +7
Talking Face Generation (TFG) strives to create realistic and emotionally expressive digital faces. While previous TFG works have mastered the creation of naturalistic facial movem…
CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling
Bichen Wang, Yixin Sun, Junzhe Wang +6
The mismatch between the growing demand for psychological counseling and the limited availability of services has motivated research into the application of Large Language Models (…
Data Uncertainty-Aware Learning for Multimodal Aspect-based Sentiment Analysis
Hao Yang, Zhenyu Zhang, Yanyan Zhao +1
As a fine-grained task, multimodal aspect-based sentiment analysis (MABSA) mainly focuses on identifying aspect-level sentiment information in the text-image pair. However, we obse…
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey
Hao Yang, Yanyan Zhao, Yang Wu +6
Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and…
An Early Evaluation of GPT-4V(ision)
Yang Wu, Shilong Wang, Hao Yang +4
In this paper, we evaluate different abilities of GPT-4V including visual understanding, language understanding, visual puzzle solving, and understanding of other modalities such a…