Occlusion Robust Face Recognition Based on Mask Learning with PairwiseDifferential Siamese Network

Abstract

Deep Convolutional Neural Networks (CNNs) have been pushing the frontier of the face recognition research in the past years. However, existing general CNN face models generalize poorly to the scenario of occlusions on variable facial areas. Inspired by the fact that a human visual system explicitly ignores occlusions and only focuses on non-occluded facial areas, we propose a mask learning strategy to find and discard the corrupted feature elements for face recognition. A mask dictionary is firstly established by exploiting the differences between the top convoluted features of occluded and occlusion-free face pairs using an innovatively designed Pairwise Differential Siamese Network (PDSN). Each item of this dictionary captures the correspondence between occluded facial areas and corrupted feature elements, which is named Feature Discarding Mask (FDM). When dealing with a face image with random partial occlusions, we generate its FDM by combining relevant dictionary items and then multiply it with the original features to eliminate those corrupted feature elements. Comprehensive experiments on both synthesized and realistic occluded face datasets show that the proposed approach significantly outperforms the state-of-the-arts.

References in corpus (6)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Learning Face Representation from Scratch
• Targeting Ultimate Accuracy: Face Recognition via Deep Embedding
• Real-Time Facial Segmentation and Performance Capture from RGB Input
• Decorrelated Adversarial Learning for Age-Invariant Face Recognition
• Orthogonal Deep Features Decomposition for Age-Invariant Face Recognition

Cited by in corpus (13)

• End2End Occluded Face Recognition by Masking Corrupted Features
• Landmark Guidance Independent Spatio-channel Attention and Complementary Context Information based Facial Expression Recognition
• Deep Feature Augmentation for Occluded Image Classification
• Generalizing Face Forgery Detection with High-frequency Features
• PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition
• A survey of face recognition techniques under occlusion
• Blind-Touch: Homomorphic Encryption-Based Distributed Neural Network Inference for Privacy-Preserving Fingerprint Authentication
• Masked Face Recognition: Human vs. Machine
• Facial Attribute Capsules for Noise Face Super Resolution
• When Face Recognition Meets Occlusion: A New Benchmark
• Matching Targets Across Domains with RADON, the Re-Identification Across Domain Network
• Multi-Margin based Decorrelation Learning for Heterogeneous Face Recognition
• On Improving the Generalization of Face Recognition in the Presence of Occlusions