Dual Variational Generation for Low-Shot Heterogeneous Face Recognition
arXiv:1903.10203
Abstract
Heterogeneous Face Recognition (HFR) is a challenging issue because of the large domain discrepancy and a lack of heterogeneous data. This paper considers HFR as a dual generation problem, and proposes a novel Dual Variational Generation (DVG) framework. It generates large-scale new paired heterogeneous images with the same identity from noise, for the sake of reducing the domain gap of HFR. Specifically, we first introduce a dual variational autoencoder to represent a joint distribution of paired heterogeneous images. Then, in order to ensure the identity consistency of the generated paired heterogeneous images, we impose a distribution alignment in the latent space and a pairwise identity preserving in the image space. Moreover, the HFR network reduces the domain discrepancy by constraining the pairwise feature distances between the generated paired heterogeneous images. Extensive experiments on four HFR databases show that our method can significantly improve state-of-the-art results. The related code is available at https://github.com/BradyFU/DVG.
arXiv commentAccepted by NeurIPS 2019
References in corpus (9)
- Auto-Encoding Variational Bayes
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Delta-encoder: an effective sample synthesis method for few-shot object recognition
- IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
- Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis
- Mode Seeking Generative Adversarial Networks for Diverse Image Synthesis
- Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognition
- High Fidelity Face Manipulation with Extreme Poses and Expressions