Zoom-RNN: A Novel Method for Person Recognition Using Recurrent Neural Networks
arXiv:1809.09189
Abstract
The overwhelming popularity of social media has resulted in bulk amounts of personal photos being uploaded to the internet every day. Since these photos are taken in unconstrained settings, recognizing the identities of people among the photos remains a challenge. Studies have indicated that utilizing evidence other than face appearance improves the performance of person recognition systems. In this work, we aim to take advantage of additional cues obtained from different body regions in a zooming in fashion for person recognition. Hence, we present Zoom-RNN, a novel method based on recurrent neural networks for combining evidence extracted from the whole body, upper body, and head regions. Our model is evaluated on a challenging dataset, namely People In Photo Albums (PIPA), and we demonstrate that employing our system improves the performance of conventional fusion methods by a noticeable margin.
arXiv comment8 pages, 5 figures
References in corpus (9)
- Sequence to Sequence Learning with Neural Networks
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models
- Rethinking the Inception Architecture for Computer Vision
- Show and Tell: A Neural Image Caption Generator
- Rethinking Feature Discrimination and Polymerization for Large-scale Recognition
- Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues
- Faceless Person Recognition; Privacy Implications in Social Media
- Pose-Aware Person Recognition