85 citations · 594 across the 81 of their papers we have counts for
14 papers · 1 filter
Audio-to-symbolic Arrangement via Cross-modal Music Representation Learning
Ziyu Wang, Dejing Xu, Gus Xia +1
Could we automatically derive the score of a piano accompaniment based on the audio of a pop song? This is the audio-to-symbolic arrangement problem we tackle in this paper. A good…
Dynamic Token Normalization Improves Vision Transformers
Wenqi Shao, Yixiao Ge, Zhaoyang Zhang +4
Vision Transformer (ViT) and its variants (e.g., Swin, PVT) have achieved great success in various computer vision tasks, owing to their capability to learn long-range contextual i…
Object-aware Video-language Pre-training for Retrieval
Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai +5
Recently, by introducing large-scale dataset and strong transformer network, video-language pre-training has shown great success especially for retrieval. Yet, existing video-langu…
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data
Xintao Wang, Liangbin Xie, Chao Dong +1
Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general rea…
Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution
Liangbin Xie, Xintao Wang, Chao Dong +2
Recent blind super-resolution (SR) methods typically consist of two branches, one for degradation prediction and the other for conditional restoration. However, our experiments sho…
Towards Vivid and Diverse Image Colorization with Generative Color Prior
Yanze Wu, Xintao Wang, Yu Li +3
Colorization has attracted increasing interest in recent years. Classic reference-based methods usually rely on external color images for plausible results. A large image database…
Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization
Fa-Ting Hong, Jia-Chang Feng, Dan Xu +2
Weakly supervised temporal action localization (WS-TAL) is a challenging task that aims to localize action instances in the given video with video-level categorical supervision. Bo…
Tracking Instances as Queries
Shusheng Yang, Yuxin Fang, Xinggang Wang +4
Recently, query based deep networks catch lots of attention owing to their end-to-end pipeline and competitive results on several fundamental computer vision tasks, such as object…
Instances as Queries
Yuxin Fang, Shusheng Yang, Xinggang Wang +5
Recently, query based object detection frameworks achieve comparable performance with previous state-of-the-art object detectors. However, how to fully leverage such frameworks to…
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
Yanbei Chen, Yongqin Xian, A. Sophia Koepke +2
Having access to multi-modal cues (e.g. vision and audio) empowers some cognitive tasks to be done faster compared to learning from a single modality. In this work, we propose to t…
Crossover Learning for Fast Online Video Instance Segmentation
Shusheng Yang, Yuxin Fang, Xinggang Wang +5
Modeling temporal visual context across frames is critical for video instance segmentation (VIS) and other video understanding tasks. In this paper, we propose a fast online VIS mo…
Open-book Video Captioning with Retrieve-Copy-Generate Network
Ziqi Zhang, Zhongang Qi, Chunfeng Yuan +4
Due to the rapid emergence of short videos and the requirement for content understanding and creation, the video captioning task has received increasing attention in recent years.…
A Generic Object Re-identification System for Short Videos
Tairu Qiu, Guanxian Chen, Zhongang Qi +3
Short video applications like TikTok and Kwai have been a great hit recently. In order to meet the increasing demands and take full advantage of visual information in short videos,…
Towards Real-World Blind Face Restoration with Generative Facial Prior
Xintao Wang, Yu Li, Honglun Zhang +1
Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. However, very low-quality input…