502 citations · 2.5k across the 78 of their papers we have counts for
20 papers · 1 filter
Attributes Aware Face Generation with Generative Adversarial Networks
Zheng Yuan, Jie Zhang, Shiguang Shan +1
Recent studies have shown remarkable success in face image generations. However, most of the existing methods only generate face images from random noise, and cannot generate face…
Learn an Effective Lip Reading Model without Pains
Dalu Feng, Shuang Yang, Shiguang Shan +1
Lip reading, also known as visual speech recognition, aims to recognize the speech content from videos by analyzing the lip dynamics. There have been several appealing progress in…
IAUnet: Global Context-Aware Feature Learning for Person Re-Identification
Ruibing Hou, Bingpeng Ma, Hong Chang +3
Person re-identification (reID) by CNNs based networks has achieved favorable performance in recent years. However, most of existing CNNs based methods do not take full advantage o…
SegFix: Model-Agnostic Boundary Refinement for Segmentation
Yuhui Yuan, Jingyi Xie, Xilin Chen +1
We present a model-agnostic post-processing scheme to improve the boundary quality for the segmentation result that is generated by any existing segmentation model. Motivated by th…
Appearance-Preserving 3D Convolution for Video-based Person Re-identification
Xinqian Gu, Hong Chang, Bingpeng Ma +2
Due to the imperfect person detection results and posture changes, temporal appearance misalignment is unavoidable in video-based person re-identification (ReID). In this case, 3D…
Temporal Complementary Learning for Video Person Re-Identification
Ruibing Hou, Hong Chang, Bingpeng Ma +2
This paper proposes a Temporal Complementary Learning Network that extracts complementary features of consecutive video frames for video person re-identification. Firstly, we intro…
Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generation
Wenbin Wang, Ruiping Wang, Shiguang Shan +1
Scene graph aims to faithfully reveal humans' perception of image content. When humans analyze a scene, they usually prefer to describe image gist first, namely major objects and k…
Synchronous Bidirectional Learning for Multilingual Lip Reading
Mingshuang Luo, Shuang Yang, Xilin Chen +2
Lip reading has received increasing attention in recent years. This paper focuses on the synergy of multilingual lip reading. There are about as many as 7000 languages in the world…
Single-Side Domain Generalization for Face Anti-Spoofing
Yunpei Jia, Jie Zhang, Shiguang Shan +1
Existing domain generalization methods for face anti-spoofing endeavor to extract common differentiation features to improve the generalization. However, due to large distribution…
Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
Yude Wang, Jie Zhang, Meina Kan +2
Image-level weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years. Most of advanced solutions exploit class activation map (…
Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learning
Guoqing Wang, Hu Han, Shiguang Shan +1
Face presentation attack detection (PAD) has been an urgent problem to be solved in the face recognition systems. Conventional approaches usually assume the testing and training ar…
Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training
Hongkai Zhang, Hong Chang, Bingpeng Ma +2
Although two-stage object detectors have continuously advanced the state-of-the-art performance in recent years, the training process itself is far from crystal. In this work, we f…
Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text
Difei Gao, Ke Li, Ruiping Wang +2
Answering questions that require reading texts in an image is challenging for current models. One key difficulty of this task is that rare, polysemous, and ambiguous words frequent…
Mutual Information Maximization for Effective Lip Reading
Xing Zhao, Shuang Yang, Shiguang Shan +1
Lip reading has received an increasing research interest in recent years due to the rapid development of deep learning and its widespread potential applications. One key point to o…
Deformation Flow Based Two-Stream Network for Lip Reading
Jingyun Xiao, Shuang Yang, Yuanhang Zhang +2
Lip reading is the task of recognizing the speech content by analyzing movements in the lip region when people are speaking. Observing on the continuity in adjacent frames in the s…
Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading
Mingshuang Luo, Shuang Yang, Shiguang Shan +1
Lip-reading aims to infer the speech content from the lip movement sequence and can be seen as a typical sequence-to-sequence (seq2seq) problem which translates the input image seq…
Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition
Yuanhang Zhang, Shuang Yang, Jingyun Xiao +2
Recent advances in deep learning have heightened interest among researchers in the field of visual speech recognition (VSR). Currently, most existing methods equate VSR with automa…
Emotion Recognition for In-the-wild Videos
Hanyu Liu, Jiabei Zeng, Shiguang Shan +1
This paper is a brief introduction to our submission to the seven basic expression classification track of Affective Behavior Analysis in-the-wild Competition held in conjunction w…
T: Multi-Modal Continuous Valence-Arousal Estimation in the Wild
Yuan-Hang Zhang, Rulin Huang, Jiabei Zeng +2
This report describes a multi-modal multi-task (T) approach underlying our submission to the valence-arousal estimation track of the Affective Behavior Analysis in-the-wild (A…
UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation
Huaishao Luo, Lei Ji, Botian Shi +6
With the recent success of the pre-training technique for NLP and image-linguistic tasks, some video-linguistic pre-training works are gradually developed to improve video-text rel…