Adversarial Discriminative Heterogeneous Face Recognition
arXiv:1709.03675
Abstract
The gap between sensing patterns of different face modalities remains a challenging problem in heterogeneous face recognition (HFR). This paper proposes an adversarial discriminative feature learning framework to close the sensing gap via adversarial learning on both raw-pixel space and compact feature space. This framework integrates cross-spectral face hallucination and discriminative feature learning into an end-to-end adversarial network. In the pixel space, we make use of generative adversarial networks to perform cross-spectral face hallucination. An elaborate two-path model is introduced to alleviate the lack of paired images, which gives consideration to both global structures and local textures. In the feature space, an adversarial loss and a high-order variance discrepancy loss are employed to measure the global and local discrepancy between two heterogeneous distributions respectively. These two losses enhance domain-invariant feature learning and modality independent noise removing. Experimental results on three NIR-VIS databases show that our proposed approach outperforms state-of-the-art HFR methods, without requiring of complex network or large-scale training dataset.
References in corpus (7)
- Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
- Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learning
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
- A Light CNN for Deep Face Representation with Noisy Labels
- Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis
- Perceptual Generative Adversarial Networks for Small Object Detection
- Not Afraid of the Dark: NIR-VIS Face Recognition via Cross-spectral Hallucination and Low-rank Embedding