297 citations · 2.2k across the 85 of their papers we have counts for
86 papers
Dynamic Multimodal Fusion via Meta-Learning Towards Micro-Video Recommendation
Han Liu, Yinwei Wei, Fan Liu +3
Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal info…
Detecting and Grounding Multi-Modal Media Manipulation and Beyond
Rui Shao, Tianxing Wu, Jianlong Wu +2
Misinformation has become a pressing issue. Fake media, in both visual and textual forms, is widespread on the web. While various deepfake detection and text fake news detection me…
Building Emotional Support Chatbots in the Era of LLMs
Zhonghua Zheng, Lizi Liao, Yang Deng +1
The integration of emotional support into various conversational scenarios presents profound societal benefits, such as social interactions, mental health counseling, and customer…
Temporal Sentence Grounding in Streaming Videos
Tian Gan, Xiao Wang, Yan Sun +3
This paper aims to tackle a novel task - Temporal Sentence Grounding in Streaming Videos (TSGSV). The goal of TSGSV is to evaluate the relevance between a video stream and a given…
LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation
Leigang Qu, Shengqiong Wu, Hao Fei +2
In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current mode…
General Debiasing for Multimodal Sentiment Analysis
Teng Sun, Juntong Ni, Wenjie Wang +3
Existing work on Multimodal Sentiment Analysis (MSA) utilizes multimodal information for prediction yet unavoidably suffers from fitting the spurious correlations between multimoda…
Semantic-Guided Feature Distillation for Multimodal Recommendation
Fan Liu, Huilin Chen, Zhiyong Cheng +2
Multimodal recommendation exploits the rich multimodal information associated with users or items to enhance the representation learning for better performance. In these methods, e…
StyleEDL: Style-Guided High-order Attention Network for Image Emotion Distribution Learning
Peiguang Jing, Xianyi Liu, Ji Wang +3
Emotion distribution learning has gained increasing attention with the tendency to express emotions through images. As for emotion ambiguity arising from humans' subjectivity, subs…
Towards Generalizable Deepfake Detection by Primary Region Regularization
Harry Cheng, Yangyang Guo, Tianyi Wang +2
The existing deepfake detection methods have reached a bottleneck in generalizing to unseen forgeries and manipulation approaches. Based on the observation that the deepfake detect…
Sample Less, Learn More: Efficient Action Recognition via Frame Feature Restoration
Harry Cheng, Yangyang Guo, Liqiang Nie +2
Training an effective video action recognition model poses significant computational challenges, particularly under limited resource budgets. Current methods primarily aim to eithe…
Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generation
Liqiang Jing, Xuemeng Song, Kun Ouyang +2
Multimodal Sarcasm Explanation (MuSE) is a new yet challenging task, which aims to generate a natural language sentence for a multimodal social post (an image as well as its captio…
A Survey on Video Moment Localization
Meng Liu, Liqiang Nie, Yunxiao Wang +2
Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query. Beyond the task of te…
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
Rui Shao, Tianxing Wu, Liqiang Nie +1
Existing deepfake detection methods fail to generalize well to unseen or degraded samples, which can be attributed to the over-fitting of low-level forgery patterns. Here we argue…
RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Search
Yang Bai, Min Cao, Daming Gao +5
Text-based person search aims to retrieve the specified person images given a textual description. The key to tackling such a challenging task is to learn powerful multi-modal repr…
Dual Semantic Knowledge Composed Multimodal Dialog Systems
Xiaolin Chen, Xuemeng Song, Yinwei Wei +2
Textual response generation is an essential task for multimodal task-oriented dialog systems.Although existing studies have achieved fruitful progress, they still suffer from two c…
Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domain
Liqiang Jing, Xuemeng Song, Xuming Lin +3
Existing data-to-text generation efforts mainly focus on generating a coherent text from non-linguistic input data, such as tables and attribute-value pairs, but overlook that diff…
Text-based Person Search without Parallel Image-Text Data
Yang Bai, Jingyao Wang, Min Cao +4
Text-based person search (TBPS) aims to retrieve the images of the target person from a large image gallery based on a given natural language description. Existing methods are domi…
Self-Training Boosted Multi-Factor Matching Network for Composed Image Retrieval
Haokun Wen, Xuemeng Song, Jianhua Yin +3
The composed image retrieval (CIR) task aims to retrieve the desired target image for a given multimodal query, i.e., a reference image with its corresponding modification text. Th…
Learnable Pillar-based Re-ranking for Image-Text Retrieval
Leigang Qu, Meng Liu, Wenjie Wang +3
Image-text retrieval aims to bridge the modality gap and retrieve cross-modal content based on semantic similarities. Prior work usually focuses on the pairwise relations (i.e., wh…
ChatLLM Network: More brains, More intelligence
Rui Hao, Linmei Hu, Weijian Qi +3
Dialogue-based language models mark a huge milestone in the field of artificial intelligence, by their impressive ability to interact with users, as well as a series of challenging…
Revisiting Context Aggregation for Image Matting
Qinglin Liu, Xiaoqian Lv, Quanling Meng +5
Traditional studies emphasize the significance of context information in improving matting performance. Consequently, deep learning-based matting methods delve into designing pooli…
Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation
Xiao Wang, Tian Gan, Yinwei Wei +3
The last decade has witnessed the proliferation of micro-videos on various user-generated content platforms. According to our statistics, around 85.7\% of micro-videos lack annotat…
Efficient Image-Text Retrieval via Keyword-Guided Pre-Screening
Min Cao, Yang Bai, Jingyao Wang +3
Under the flourishing development in performance, current image-text retrieval methods suffer from -related time complexity, which hinders their application in practice. Targeti…
Reliable Representation Learning for Incomplete Multi-View Missing Multi-Label Classification
Chengliang Liu, Jie Wen, Yong Xu +3
As a cross-topic of multi-view learning and multi-label classification, multi-view multi-label classification has gradually gained traction in recent years. The application of mult…