5 papers
Parameter Aware Mamba Model for Multi-task Dense Prediction
Xinzhuo Yu, Yunzhi Zhuge, Sitong Gong +3
Understanding the inter-relations and interactions between tasks is crucial for multi-task dense prediction. Existing methods predominantly utilize convolutional layers and attenti…
Complementary and Contrastive Learning for Audio-Visual Segmentation
Sitong Gong, Yunzhi Zhuge, Lu Zhang +2
Audio-Visual Segmentation (AVS) aims to generate pixel-wise segmentation maps that correlate with the auditory signals of objects. This field has seen significant progress with num…
Reinforcing Video Reasoning Segmentation to Think Before It Segments
Sitong Gong, Lu Zhang, Yunzhi Zhuge +3
Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous appr…
The Devil is in Temporal Token: High Quality Video Reasoning Segmentation
Sitong Gong, Yunzhi Zhuge, Lu Zhang +3
Existing methods for Video Reasoning Segmentation rely heavily on a single special token to represent the object in the keyframe or the entire video, inadequately capturing spatial…
AVS-Mamba: Exploring Temporal and Multi-modal Mamba for Audio-Visual Segmentation
Sitong Gong, Yunzhi Zhuge, Lu Zhang +4
The essence of audio-visual segmentation (AVS) lies in locating and delineating sound-emitting objects within a video stream. While Transformer-based methods have shown promise, th…