923 citations · 1.1k across the 48 of their papers we have counts for
6 papers · 1 filter
Contrastive Video-Language Segmentation
Chen Liang, Yawei Luo, Yu Wu +1
We focus on the problem of segmenting a certain object referred by a natural language sentence in video content, at the core of formulating a pinpoint vision-language relation. Whi…
Saying the Unseen: Video Descriptions via Dialog Agents
Ye Zhu, Yu Wu, Yi Yang +1
Current vision and language tasks usually take complete visual data (e.g., raw images or videos) as input, however, practical scenarios may often consist the situations where part…
Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation
Chen Liang, Yu Wu, Tianfei Zhou +4
Referring video object segmentation (RVOS) aims to segment video objects with the guidance of natural language reference. Previous methods typically tackle RVOS through directly gr…
ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation
Chen Liang, Yu Wu, Yawei Luo +1
Text-based video segmentation is a challenging task that segments out the natural language referred objects in videos. It essentially requires semantic comprehension and fine-grain…
Learning Audio-Visual Correlations from Variational Cross-Modal Generation
Ye Zhu, Yu Wu, Hugo Latapie +2
People can easily imagine the potential sound while seeing an event. This natural synchronization between audio and visual signals reveals their intrinsic correlations. To this end…
Learning to Anticipate Egocentric Actions by Imagination
Yu Wu, Linchao Zhu, Xiaohan Wang +2
Anticipating actions before they are executed is crucial for a wide range of practical applications, including autonomous driving and robotics. In this paper, we study the egocentr…