538 citations · 2.4k across the 71 of their papers we have counts for
27 papers · 1 filter
ANetQA: A Large-scale Benchmark for Fine-grained Compositional Reasoning over Untrimmed Videos
Zhou Yu, Lixiang Zheng, Zhou Zhao +4
Building benchmarks to systemically analyze different capabilities of video question answering (VideoQA) models is challenging yet crucial. Existing benchmarks often use non-compos…
Set-Based Face Recognition Beyond Disentanglement: Burstiness Suppression With Variance Vocabulary
Jiong Wang, Zhou Zhao, Fei Wu
Set-based face recognition (SFR) aims to recognize the face sets in the unconstrained scenario, where the appearance of same identity may change dramatically with extreme variances…
Frame-Subtitle Self-Supervision for Multi-Modal Video Question Answering
Jiong Wang, Zhou Zhao, Weike Jin
Multi-modal video question answering aims to predict correct answer and localize the temporal boundary relevant to the question. The temporal annotations of questions improve QA pe…
End-to-End Modeling via Information Tree for One-Shot Natural Language Spatial Video Grounding
Mengze Li, Tianbao Wang, Haoyu Zhang +9
Natural language spatial video grounding aims to detect the relevant objects in video frames with descriptive sentences as the query. In spite of the great advances, most existing…
VLAD-VSA: Cross-Domain Face Presentation Attack Detection with Vocabulary Separation and Adaptation
Jiong Wang, Zhou Zhao, Weike Jin +5
For face presentation attack detection (PAD), most of the spoofing cues are subtle, local image patterns (e.g., local image distortion, 3D mask edge and cut photo edges). The repre…
SimulSLT: End-to-End Simultaneous Sign Language Translation
Aoxiong Yin, Zhou Zhao, Jinglin Liu +4
Sign language translation as a kind of technology with profound social significance has attracted growing researchers' interest in recent years. However, the existing sign language…
Test-time Batch Statistics Calibration for Covariate Shift
Fuming You, Jingjing Li, Zhou Zhao
Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-co…
SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory
Zhijie Lin, Zhou Zhao, Haoyuan Li +4
Lip reading, aiming to recognize spoken sentences according to the given video of lip movements without relying on the audio stream, has attracted great interest due to its applica…
Modeling High-order Interactions across Multi-interests for Micro-video Recommendation
Dong Yao, Shengyu Zhang, Zhou Zhao +4
Personalized recommendation system has become pervasive in various video platform. Many effective methods have been proposed, but most of them didn't capture the user's multi-level…
MGD-GAN: Text-to-Pedestrian generation through Multi-Grained Discrimination
Shengyu Zhang, Donghui Wang, Zhou Zhao +3
In this paper, we investigate the problem of text-to-pedestrian synthesis, which has many potential applications in art, design, and video surveillance. Existing methods for text-t…
DeVLBert: Learning Deconfounded Visio-Linguistic Representations
Shengyu Zhang, Tan Jiang, Tan Wang +6
In this paper, we propose to investigate the problem of out-of-domain visio-linguistic pretraining, where the pretraining data distribution differs from that of downstream data on…
Object-Aware Multi-Branch Relation Networks for Spatio-Temporal Video Grounding
Zhu Zhang, Zhou Zhao, Zhijie Lin +2
Spatio-temporal video grounding aims to retrieve the spatio-temporal tube of a queried object according to the given sentence. Currently, most existing grounding methods are restri…
Regularized Two-Branch Proposal Networks for Weakly-Supervised Moment Retrieval in Videos
Zhu Zhang, Zhijie Lin, Zhou Zhao +2
Video moment retrieval aims to localize the target moment in an video according to the given sentence. The weak-supervised setting only provides the video-level sentence annotation…
Poet: Product-oriented Video Captioner for E-commerce
Shengyu Zhang, Ziqi Tan, Jin Yu +6
In e-commerce, a growing number of user-generated videos are used for product promotion. How to generate video descriptions that narrate the user-preferred product characteristics…
Comprehensive Information Integration Modeling Framework for Video Titling
Shengyu Zhang, Ziqi Tan, Jin Yu +6
In e-commerce, consumer-generated videos, which in general deliver consumers' individual preferences for the different aspects of certain products, are massive in volume. To recomm…
Grounded and Controllable Image Completion by Incorporating Lexical Semantics
Shengyu Zhang, Tan Jiang, Qinghao Huang +7
In this paper, we present an approach, namely Lexical Semantic Image Completion (LSIC), that may have potential applications in art, design, and heritage conservation, among severa…
Convolutional Hierarchical Attention Network for Query-Focused Video Summarization
Shuwen Xiao, Zhou Zhao, Zijian Zhang +2
Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's prefer…
Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences
Zhu Zhang, Zhou Zhao, Yang Zhao +3
In this paper, we consider a novel task, Spatio-Temporal Video Grounding for Multi-Form Sentences (STVG). Given an untrimmed video and a declarative/interrogative sentence depictin…
Weakly-Supervised Video Moment Retrieval via Semantic Completion Network
Zhijie Lin, Zhou Zhao, Zhu Zhang +2
Video moment retrieval is to search the moment that is most relevant to the given natural language query. Existing methods are mostly trained in a fully-supervised setting, which r…
A Better Way to Attend: Attention with Trees for Video Question Answering
Hongyang Xue, Wenqing Chu, Zhou Zhao +1
We propose a new attention model for video question answering. The main idea of the attention models is to locate on the most informative parts of the visual data. The attention me…
Localizing Unseen Activities in Video via Image Query
Zhu Zhang, Zhou Zhao, Zhijie Lin +2
Action localization in untrimmed videos is an important topic in the field of video understanding. However, existing action localization methods are restricted to a pre-defined set…
Open-Ended Long-Form Video Question Answering via Hierarchical Convolutional Self-Attention Networks
Zhu Zhang, Zhou Zhao, Zhijie Lin +2
Open-ended video question answering aims to automatically generate the natural-language answer from referenced video contents according to the given question. Currently, most exist…
ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answering
Zhou Yu, Dejing Xu, Jun Yu +4
Recent developments in modeling language and vision have been successfully applied to image question answering. It is both crucial and natural to extend this research direction to…
Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval
Lianli Gao, Xiaosu Zhu, Jingkuan Song +2
Product Quantization (PQ) has long been a mainstream for generating an exponentially large codebook at very low memory/time cost. Despite its success, PQ is still tricky for the de…