421 citations · 1.7k across the 83 of their papers we have counts for
19 papers · 1 filter
Attributes Aware Face Generation with Generative Adversarial Networks
Zheng Yuan, Jie Zhang, Shiguang Shan +1
Recent studies have shown remarkable success in face image generations. However, most of the existing methods only generate face images from random noise, and cannot generate face…
Learn an Effective Lip Reading Model without Pains
Dalu Feng, Shuang Yang, Shiguang Shan +1
Lip reading, also known as visual speech recognition, aims to recognize the speech content from videos by analyzing the lip dynamics. There have been several appealing progress in…
IAUnet: Global Context-Aware Feature Learning for Person Re-Identification
Ruibing Hou, Bingpeng Ma, Hong Chang +3
Person re-identification (reID) by CNNs based networks has achieved favorable performance in recent years. However, most of existing CNNs based methods do not take full advantage o…
Temporal Complementary Learning for Video Person Re-Identification
Ruibing Hou, Hong Chang, Bingpeng Ma +2
This paper proposes a Temporal Complementary Learning Network that extracts complementary features of consecutive video frames for video person re-identification. Firstly, we intro…
Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generation
Wenbin Wang, Ruiping Wang, Shiguang Shan +1
Scene graph aims to faithfully reveal humans' perception of image content. When humans analyze a scene, they usually prefer to describe image gist first, namely major objects and k…
Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling
Xuesong Niu, Zitong Yu, Hu Han +3
Remote physiological measurements, e.g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playin…
PA-GAN: Progressive Attention Generative Adversarial Network for Facial Attribute Editing
Zhenliang He, Meina Kan, Jichao Zhang +1
Facial attribute editing aims to manipulate attributes on the human face, e.g., adding a mustache or changing the hair color. Existing approaches suffer from a serious compromise b…
Synchronous Bidirectional Learning for Multilingual Lip Reading
Mingshuang Luo, Shuang Yang, Xilin Chen +2
Lip reading has received increasing attention in recent years. This paper focuses on the synergy of multilingual lip reading. There are about as many as 7000 languages in the world…
Single-Side Domain Generalization for Face Anti-Spoofing
Yunpei Jia, Jie Zhang, Shiguang Shan +1
Existing domain generalization methods for face anti-spoofing endeavor to extract common differentiation features to improve the generalization. However, due to large distribution…
Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
Yude Wang, Jie Zhang, Meina Kan +2
Image-level weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years. Most of advanced solutions exploit class activation map (…
Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learning
Guoqing Wang, Hu Han, Shiguang Shan +1
Face presentation attack detection (PAD) has been an urgent problem to be solved in the face recognition systems. Conventional approaches usually assume the testing and training ar…
Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text
Difei Gao, Ke Li, Ruiping Wang +2
Answering questions that require reading texts in an image is challenging for current models. One key difficulty of this task is that rare, polysemous, and ambiguous words frequent…
The 1st Challenge on Remote Physiological Signal Sensing (RePSS)
Xiaobai Li, Hu Han, Hao Lu +5
Remote measurement of physiological signals from videos is an emerging topic. The topic draws great interests, but the lack of publicly available benchmark databases and a fair val…
Mutual Information Maximization for Effective Lip Reading
Xing Zhao, Shuang Yang, Shiguang Shan +1
Lip reading has received an increasing research interest in recent years due to the rapid development of deep learning and its widespread potential applications. One key point to o…
Deformation Flow Based Two-Stream Network for Lip Reading
Jingyun Xiao, Shuang Yang, Yuanhang Zhang +2
Lip reading is the task of recognizing the speech content by analyzing movements in the lip region when people are speaking. Observing on the continuity in adjacent frames in the s…
Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading
Mingshuang Luo, Shuang Yang, Shiguang Shan +1
Lip-reading aims to infer the speech content from the lip movement sequence and can be seen as a typical sequence-to-sequence (seq2seq) problem which translates the input image seq…
Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition
Yuanhang Zhang, Shuang Yang, Jingyun Xiao +2
Recent advances in deep learning have heightened interest among researchers in the field of visual speech recognition (VSR). Currently, most existing methods equate VSR with automa…
Emotion Recognition for In-the-wild Videos
Hanyu Liu, Jiabei Zeng, Shiguang Shan +1
This paper is a brief introduction to our submission to the seven basic expression classification track of Affective Behavior Analysis in-the-wild Competition held in conjunction w…
T: Multi-Modal Continuous Valence-Arousal Estimation in the Wild
Yuan-Hang Zhang, Rulin Huang, Jiabei Zeng +2
This report describes a multi-modal multi-task (T) approach underlying our submission to the valence-arousal estimation track of the Affective Behavior Analysis in-the-wild (A…