517 citations · 1.7k across the 49 of their papers we have counts for
10 papers · 2 filters
Contrastive Video-Language Segmentation
Chen Liang, Yawei Luo, Yu Wu +1
We focus on the problem of segmenting a certain object referred by a natural language sentence in video content, at the core of formulating a pinpoint vision-language relation. Whi…
Saying the Unseen: Video Descriptions via Dialog Agents
Ye Zhu, Yu Wu, Yi Yang +1
Current vision and language tasks usually take complete visual data (e.g., raw images or videos) as input, however, practical scenarios may often consist the situations where part…
Less is More: Sparse Sampling for Dense Reaction Predictions
Kezhou Lin, Xiaohan Wang, Zhedong Zheng +2
Obtaining viewer responses from videos can be useful for creators and streaming platforms to analyze the video performance and improve the future user experience. In this report, w…
Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation
Chen Liang, Yu Wu, Tianfei Zhou +4
Referring video object segmentation (RVOS) aims to segment video objects with the guidance of natural language reference. Previous methods typically tackle RVOS through directly gr…
T2VLAD: Global-Local Sequence Alignment for Text-Video Retrieval
Xiaohan Wang, Linchao Zhu, Yi Yang
Text-video retrieval is a challenging task that aims to search relevant video contents based on natural language descriptions. The key to this problem is to measure text-video simi…
ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation
Chen Liang, Yu Wu, Yawei Luo +1
Text-based video segmentation is a challenging task that segments out the natural language referred objects in videos. It essentially requires semantic comprehension and fine-grain…