29 citations · 102 across the 13 of their papers we have counts for
14 papers
2nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VA
Zhiyu Wang, Xudong Kang, Shutao Li
Audio-based video object segmentation aims to locate and segment objects in videos conditioned on audio cues, requiring precise understanding of both appearance and motion. Recent…
Multimodal Prompt Alignment for Facial Expression Recognition
Fuyan Ma, Yiran He, Bin Sun +1
Prompt learning has been widely adopted to efficiently adapt vision-language models (VLMs) like CLIP for various downstream tasks. Despite their success, current VLM-based facial e…
NTIRE 2025 challenge on Text to Image Generation Model Quality Assessment
Shuhao Han, Haotian Fan, Fangyuan Kong +112
This paper reports on the NTIRE 2025 challenge on Text to Image (T2I) generation model quality assessment, which will be held in conjunction with the New Trends in Image Restoratio…
DiffCL: A Diffusion-Based Contrastive Learning Framework with Semantic Alignment for Multimodal Recommendations
Qiya Song, Jiajun Hu, Lin Xiao +3
Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling…
DrVideo: Document Retrieval Based Long Video Understanding
Ziyu Ma, Chenhui Gou, Hengcan Shi +4
Most of the existing methods for video understanding primarily focus on videos only lasting tens of seconds, with limited exploration of techniques for handling long videos. The in…
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question Answering
Ziyu Ma, Shutao Li, Bin Sun +3
Knowledge-based visual question answering (VQA) requires world knowledge beyond the image for accurate answer. Recently, instead of extra knowledge bases, a large language model (L…
PVPUFormer: Probabilistic Visual Prompt Unified Transformer for Interactive Image Segmentation
Xu Zhang, Kailun Yang, Jiacheng Lin +3
Integration of diverse visual prompts like clicks, scribbles, and boxes in interactive image segmentation significantly facilitates users' interaction as well as improves interacti…
LOGO-Former: Local-Global Spatio-Temporal Transformer for Dynamic Facial Expression Recognition
Fuyan Ma, Bin Sun, Shutao Li
Previous methods for dynamic facial expression recognition (DFER) in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range…
Learning to Locate Visual Answer in Video Corpus Using Question
Bin Li, Yixuan Weng, Bin Sun +1
We introduce a new task, named video corpus visual answer localization (VCVAL), which aims to locate the visual answer in a large collection of untrimmed instructional videos using…
Scene-Aware Prompt for Multi-modal Dialogue Understanding and Generation
Bin Li, Yixuan Weng, Ziyu Ma +2
This paper introduces the schemes of Team LingJing's experiments in NLPCC-2022-Shared-Task-4 Multi-modal Dialogue Understanding and Generation (MDUG). The MDUG task can be divided…
Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wild
Fuyan Ma, Bin Sun, Shutao Li
Previous methods for dynamic facial expression in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in vi…
LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphs
Fei Xia, Bin Li, Yixuan Weng +5
The medical conversational system can relieve the burden of doctors and improve the efficiency of healthcare, especially during the pandemic. This paper presents a medical conversa…
Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Video
Bin Li, Yixuan Weng, Bin Sun +1
The temporal answering grounding in the video (TAGV) is a new task naturally derived from temporal sentence grounding in the video (TSGV). Given an untrimmed video and a text quest…
Prompt-based System for Personality and Interpersonal Reactivity Prediction
Bin Li, Yixuan Weng
This paper describes our proposed method for the Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis (WASSA) 2022 shared task on Personality Pre…