Face Attribute Prediction Using Off-the-Shelf CNN Features
arXiv:1602.03935
Abstract
Predicting attributes from face images in the wild is a challenging computer vision problem. To automatically describe face attributes from face containing images, traditionally one needs to cascade three technical blocks --- face localization, facial descriptor construction, and attribute classification --- in a pipeline. As a typical classification problem, face attribute prediction has been addressed using deep learning. Current state-of-the-art performance was achieved by using two cascaded Convolutional Neural Networks (CNNs), which were specifically trained to learn face localization and attribute description. In this paper, we experiment with an alternative way of employing the power of deep representations from CNNs. Combining with conventional face localization techniques, we use off-the-shelf architectures trained for face recognition to build facial descriptors. Recognizing that the describable face attributes are diverse, our face descriptors are constructed from different levels of the CNNs for different attributes to best facilitate face attribute prediction. Experiments on two large datasets, LFWA and CelebA, show that our approach is entirely comparable to the state-of-the-art. Our findings not only demonstrate an efficient face attribute prediction approach, but also raise an important question: how to leverage the power of off-the-shelf CNN representations for novel tasks.
In proceeding of 2016 International Conference on Biometrics (ICB)
References in corpus (6)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Learning Face Representation from Scratch
- Going Deeper with Convolutions
- DeepID3: Face Recognition with Very Deep Neural Networks
- Attribute2Image: Conditional Image Generation from Visual Attributes
- Factors of Transferability for a Generic ConvNet Representation
Cited by in corpus (4)
- Registration-free Face-SSD: Single shot analysis of smiles, facial attributes, and affect in the wild
- A Jointly Learned Deep Architecture for Facial Attribute Analysis and Face Detection in the Wild
- MarioQA: Answering Questions by Watching Gameplay Videos
- Deep Sketch-Photo Face Recognition Assisted by Facial Attributes