313 citations · 1.1k across the 65 of their papers we have counts for
19 papers · 1 filter
1st Place Solution for the 5th LSVOS Challenge: Video Instance Segmentation
Tao Zhang, Xingye Tian, Yikang Zhou +7
Video instance segmentation is a challenging task that serves as the cornerstone of numerous downstream applications, including video editing and autonomous driving. In this report…
Vision-Based Human Pose Estimation via Deep Learning: A Survey
Gongjin Lan, Yu Wu, Fei Hu +1
Human pose estimation (HPE) has attracted a significant amount of attention from the computer vision community in the past decades. Moreover, HPE has been applied to various domain…
DVIS: Decoupled Video Instance Segmentation Framework
Tao Zhang, Xingye Tian, Yu Wu +4
Video instance segmentation (VIS) is a critical task with diverse applications, including autonomous driving and video editing. Existing methods often underperform on complex and l…
1st Place Solution for PVUW Challenge 2023: Video Panoptic Segmentation
Tao Zhang, Xingye Tian, Haoran Wei +6
Video panoptic segmentation is a challenging task that serves as the cornerstone of numerous downstream applications, including video editing and autonomous driving. We believe tha…
Diffusion in Diffusion: Cyclic One-Way Diffusion for Text-Vision-Conditioned Generation
Ruoyu Wang, Yongqi Yang, Zhihao Qian +2
Originating from the diffusion phenomenon in physics that describes particle movement, the diffusion generative models inherit the characteristics of stochastic random walk in the…
Multi-spectral Class Center Network for Face Manipulation Detection and Localization
Changtao Miao, Qi Chu, Zhentao Tan +7
As deepfake content proliferates online, advancing face manipulation forensics has become crucial. To combat this emerging threat, previous methods mainly focus on studying how to…
Click-Feedback Retrieval
Zeyu Wang, Yu Wu
Retrieving target information based on input query is of fundamental importance in many real-world applications. In practice, it is not uncommon for the initial search to fail, whe…
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World
Qifan Yu, Juncheng Li, Yu Wu +3
Scene Graph Generation (SGG) aims to extract <subject, predicate, object> relationships in images for vision understanding. Although recent works have made steady progress on SGG,…
Boundary Guided Learning-Free Semantic Control with Diffusion Models
Ye Zhu, Yu Wu, Zhiwei Deng +2
Applying pre-trained generative denoising diffusion models (DDMs) for downstream tasks such as image semantic editing usually requires either fine-tuning DDMs or learning auxiliary…
Vision+X: A Survey on Multimodal Learning in the Light of Data
Ye Zhu, Yu Wu, Nicu Sebe +1
We are perceiving and communicating with the world in a multisensory manner, where different information sources are sophisticatedly processed and interpreted by separate parts of…
Enhancing Targeted Attack Transferability via Diversified Weight Pruning
Hung-Jui Wang, Yu-Yu Wu, Shang-Tse Chen
Malicious attackers can generate targeted adversarial examples by imposing tiny noises, forcing neural networks to produce specific incorrect outputs. With cross-model transferabil…
Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation
Ye Zhu, Yu Wu, Kyle Olszewski +3
Diffusion probabilistic models (DPMs) have become a popular approach to conditional generation, due to their promising results and support for cross-modal synthesis. A key desidera…
Prompt-aligned Gradient for Prompt Tuning
Beier Zhu, Yulei Niu, Yucheng Han +2
Thanks to the large pre-trained vision-language models (VLMs) like CLIP, we can craft a zero-shot classifier by "prompt", e.g., the confidence score of an image being "[CLASS]" can…
Lesion Localization in OCT by Semi-Supervised Object Detection
Yue Wu, Yang Zhou, Jianchun Zhao +4
Over 300 million people worldwide are affected by various retinal diseases. By noninvasive Optical Coherence Tomography (OCT) scans, a number of abnormal structural changes in the…
Quantized GAN for Complex Music Generation from Dance Videos
Ye Zhu, Kyle Olszewski, Yu Wu +4
We present Dance2Music-GAN (D2M-GAN), a novel adversarial multi-modal framework that generates complex musical samples conditioned on dance videos. Our proposed framework takes dan…
Revisiting EmbodiedQA: A Simple Baseline and Beyond
Yu Wu, Lu Jiang, Yi Yang
In Embodied Question Answering (EmbodiedQA), an agent interacts with an environment to gather necessary information for answering user questions. Existing works have laid a solid f…
Auto-ReID: Searching for a Part-aware ConvNet for Person Re-Identification
Ruijie Quan, Xuanyi Dong, Yu Wu +2
Prevailing deep convolutional neural networks (CNNs) for person re-IDentification (reID) are usually built upon ResNet or VGG backbones, which were originally designed for classifi…
Decoupled Novel Object Captioner
Yu Wu, Linchao Zhu, Lu Jiang +1
Image captioning is a challenging task where the machine automatically describes an image by sentences or phrases. It often requires a large number of paired image-sentence annotat…
A Comparative Study for the Nuclear Norms Minimization Methods
Zhiyuan Zha, Bihan Wen, Jiachao Zhang +2
The nuclear norm minimization (NNM) is commonly used to approximate the matrix rank by shrinking all singular values equally. However, the singular values have clear physical meani…