30 citations · 43 across the 9 of their papers we have counts for
10 papers
EmAvatar: Multimodal Empathetic Response Generation via Conflict Resolution and Expressive Guidance
Xiaolin Chen, Xuemeng Song, Jinlan Fu +3
Avatar-based multimodal empathetic response generation has emerged as a pivotal capability in human-centric systems, aiming to recognize user emotions and synthesize responses with…
ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models
Xiaolin Chen, Xuemeng Song, Wenhao Shi +3
Existing visual emotion understanding methods typically ignore cultural variations in emotional perception. We introduce culture-conditioned visual emotion understanding, a task th…
FashionLens: Toward Versatile Fashion Image Retrieval via Task-Adaptive Learning
Haokun Wen, Xuemeng Song, Xinghao Xie +3
Fashion image retrieval is a cornerstone of modern e-commerce systems. A unified framework that supports diverse query formats and search intentions is highly desired in practice.…
Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systems
Xiaolin Chen, Xuemeng Song, Haokun Wen +3
Textual response generation is pivotal for multimodal \mbox{task-oriented} dialog systems, which aims to generate proper textual responses based on the multimodal context. While ex…
Do Vision-Language Transformers Exhibit Visual Commonsense? An Empirical Study of VCR
Zhenyang Li, Yangyang Guo, Kejie Wang +3
Visual Commonsense Reasoning (VCR) calls for explanatory reasoning behind question answering over visual scenes. To achieve this goal, a model is required to provide an acceptable…
Simple but Effective Raw-Data Level Multimodal Fusion for Composed Image Retrieval
Haokun Wen, Xuemeng Song, Xiaolin Chen +3
Composed image retrieval (CIR) aims to retrieve the target image based on a multimodal query, i.e., a reference image paired with corresponding modification text. Recent CIR studie…
Interactive Garment Recommendation with User in the Loop
Federico Becattini, Xiaolin Chen, Andrea Puccia +4
Recommending fashion items often leverages rich user profiles and makes targeted suggestions based on past history and previous purchases. In this paper, we work under the assumpti…
Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation
Le Xiao, Xiaolin Chen
News summary generation is an important task in the field of intelligence analysis, which can provide accurate and comprehensive information to help people better understand and re…
Dual Semantic Knowledge Composed Multimodal Dialog Systems
Xiaolin Chen, Xuemeng Song, Yinwei Wei +2
Textual response generation is an essential task for multimodal task-oriented dialog systems.Although existing studies have achieved fruitful progress, they still suffer from two c…
Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
Xiaolin Chen, Xuemeng Song, Liqiang Jing +3
Text response generation for multimodal task-oriented dialog systems, which aims to generate the proper text response given the multimodal context, is an essential yet challenging…