Hierarchical Deep CNN Feature Set-Based Representation Learning for Robust Cross-Resolution Face Recognition

Abstract

Cross-resolution face recognition (CRFR), which is important in intelligent surveillance and biometric forensics, refers to the problem of matching a low-resolution (LR) probe face image against high-resolution (HR) gallery face images. Existing shallow learning-based and deep learning-based methods focus on mapping the HR-LR face pairs into a joint feature space where the resolution discrepancy is mitigated. However, little works consider how to extract and utilize the intermediate discriminative features from the noisy LR query faces to further mitigate the resolution discrepancy due to the resolution limitations. In this study, we desire to fully exploit the multi-level deep convolutional neural network (CNN) feature set for robust CRFR. In particular, our contributions are threefold. (i) To learn more robust and discriminative features, we desire to adaptively fuse the contextual features from different layers. (ii) To fully exploit these contextual features, we design a feature set-based representation learning (FSRL) scheme to collaboratively represent the hierarchical features for more accurate recognition. Moreover, FSRL utilizes the primitive form of feature maps to keep the latent structural information, especially in noisy cases. (iii) To further promote the recognition performance, we desire to fuse the hierarchical recognition outputs from different stages. Meanwhile, the discriminability from different scales can also be fully integrated. By exploiting these advantages, the efficiency of the proposed method can be delivered. Experimental results on several face datasets have verified the superiority of the presented algorithm to the other competitive CRFR approaches.

IEEE Transactions on Circuits and Systems for Video Technology, 11 pages, 9 figures

References in corpus (5)

• Learning Face Representation from Scratch
• Low-resolution Face Recognition in the Wild via Selective Knowledge Distillation
• On Low-Resolution Face Recognition in the Wild: Comparisons and New Techniques
• SiGAN: Siamese Generative Adversarial Network for Identity-Preserving Face Hallucination
• Exploiting temporal and depth information for multi-frame face anti-spoofing

Cited by in corpus (4)

• Joint Face Image Restoration and Frontalization for Recognition
• JDSR-GAN: Constructing An Efficient Joint Learning Network for Masked Face Super-Resolution
• CTU Depth Decision Algorithms for HEVC: A Survey
• MSCFNet: A Lightweight Network With Multi-Scale Context Fusion for Real-Time Semantic Segmentation