216 citations · 1.9k across the 97 of their papers we have counts for
101 papers
DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory
Shengming Yin, Chenfei Wu, Jian Liang +4
Controllable video generation has gained significant attention in recent years. However, two main limitations persist: Firstly, most existing works focus on either text, image, or…
VNVC: A Versatile Neural Video Coding Framework for Efficient Human-Machine Vision
Xihua Sheng, Li Li, Dong Liu +1
Almost all digital videos are coded into compact representations before being transmitted. Such compact representations need to be decoded back to pixels before being displayed to…
Detect Any Shadow: Segment Anything for Video Shadow Detection
Yonghui Wang, Wengang Zhou, Yunyao Mao +1
Segment anything model (SAM) has achieved great success in the field of natural image segmentation. Nevertheless, SAM tends to consider shadows as background and therefore does not…
Stare at What You See: Masked Image Modeling without Reconstruction
Hongwei Xue, Peng Gao, Hongyang Li +4
Masked Autoencoders (MAE) have been prevailing paradigms for large-scale vision representation pre-training. By reconstructing masked image patches from a small portion of visible…
Fine-grained Semantic Alignment Network for Weakly Supervised Temporal Language Grounding
Yuechen Wang, Wengang Zhou, Houqiang Li
Temporal language grounding (TLG) aims to localize a video segment in an untrimmed video based on a natural language description. To alleviate the expensive cost of manual annotati…
UDoc-GAN: Unpaired Document Illumination Correction with Background Light Prior
Yonghui Wang, Wengang Zhou, Zhenbo Lu +1
Document images captured by mobile devices are usually degraded by uncontrollable illumination, which hampers the clarity of document content. Recently, a series of research effort…
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment
Hongwei Xue, Yuchong Sun, Bei Liu +4
The pre-trained image-text models, like CLIP, have demonstrated the strong power of vision-language representation learned from a large scale of web-collected image-text data. In l…
Low-Light Video Enhancement with Synthetic Event Guidance
Lin Liu, Junfeng An, Jianzhuang Liu +6
Low-light video enhancement (LLVE) is an important yet challenging task with many applications such as photographing and autonomous driving. Unlike single image low-light enhanceme…
Neighbor Correspondence Matching for Flow-based Video Frame Synthesis
Zhaoyang Jia, Yan Lu, Houqiang Li
Video frame synthesis, which consists of interpolation and extrapolation, is an essential video processing technique that can be applied to various scenarios. However, most existin…
Semantic Image Synthesis via Diffusion Models
Wengang Zhou, Weilun Wang, Jianmin Bao +4
Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in various image generation tasks compared with Generative Adversarial Nets (GANs). Recent work on…
Multi-Target Active Object Tracking with Monte Carlo Tree Search and Target Motion Modeling
Zheng Chen, Jian Zhao, Mingyu Yang +2
In this work, we are dedicated to multi-target active object tracking (AOT), where there are multiple targets as well as multiple cameras in the environment. The goal is maximize t…
Estimation of Reliable Proposal Quality for Temporal Action Detection
Junshan Hu, Chaoxu guo, Liansheng Zhuang +4
Temporal action detection (TAD) aims to locate and recognize the actions in an untrimmed video. Anchor-free methods have made remarkable progress which mainly formulate TAD into tw…
Learning Enriched Illuminants for Cross and Single Sensor Color Constancy
Xiaodong Cun, Zhendong Wang, Chi-Man Pun +4
Color constancy aims to restore the constant colors of a scene under different illuminants. However, due to the existence of camera spectral sensitivity, the network trained on a c…
MVP: Multimodality-guided Visual Pre-training
Longhui Wei, Lingxi Xie, Wengang Zhou +2
Recently, masked image modeling (MIM) has become a promising direction for visual pre-training. In the context of vision transformers, MIM learns effective visual representation by…
TAPE: Task-Agnostic Prior Embedding for Image Restoration
Lin Liu, Lingxi Xie, Xiaopeng Zhang +5
Learning a generalized prior for natural image restoration is an important yet challenging task. Early methods mostly involved handcrafted priors including normalized sparsity, l_0…
Coordinate-Aligned Multi-Camera Collaboration for Active Multi-Object Tracking
Zeyu Fang, Jian Zhao, Mingyu Yang +3
Active Multi-Object Tracking (AMOT) is a task where cameras are controlled by a centralized system to adjust their poses automatically and collaboratively so as to maximize the cov…
Revisiting QMIX: Discriminative Credit Assignment by Gradient Entropy Regularization
Jian Zhao, Yue Zhang, Xunhan Hu +5
In cooperative multi-agent systems, agents jointly take actions and receive a team reward instead of individual rewards. In the absence of individual reward signals, credit assignm…
Direct Molecular Conformation Generation
Jinhua Zhu, Yingce Xia, Chang Liu +9
Molecular conformation generation aims to generate three-dimensional coordinates of all the atoms in a molecule and is an important task in bioinformatics and pharmacology. Previou…
Representing Videos as Discriminative Sub-graphs for Action Recognition
Dong Li, Zhaofan Qiu, Yingwei Pan +3
Human actions are typically of combinatorial structures or patterns, i.e., subjects, objects, plus spatio-temporal interactions in between. Discovering such structures is therefore…
Radio-Assisted Human Detection
Chengrun Qiu, Dongheng Zhang, Yang Hu +3
In this paper, we propose a radio-assisted human detection framework by incorporating radio information into the state-of-the-art detection methods, including anchor-based onestage…
Learning Token-based Representation for Image Retrieval
Hui Wu, Min Wang, Wengang Zhou +2
In image retrieval, deep local features learned in a data-driven manner have been demonstrated effective to improve retrieval performance. To realize efficient retrieval on large i…
Observing Interventions: A logic for thinking about experiments
Fausto Barbero, Katrin Schulz, Fernando R. Velázquez-Quesada +1
This paper makes a first step towards a logic of learning from experiments. For this, we investigate formal frameworks for modeling the interaction of causal and (qualitative) epis…
Contextual Similarity Aggregation with Self-attention for Visual Re-ranking
Jianbo Ouyang, Hui Wu, Min Wang +2
In content-based image retrieval, the first-round retrieval result by simple visual feature comparison may be unsatisfactory, which can be refined by visual re-ranking techniques.…
SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition
Hezhen Hu, Weichao Zhao, Wengang Zhou +2
Hand gesture serves as a critical role in sign language. Current deep-learning-based sign language recognition (SLR) methods may suffer insufficient interpretability and overfittin…