Improved Person Re-Identification Based on Saliency and Semantic Parsing with Deep Neural Network Models

Abstract

Given a video or an image of a person acquired from a camera, person re-identification is the process of retrieving all instances of the same person from videos or images taken from a different camera with non-overlapping view. This task has applications in various fields, such as surveillance, forensics, robotics, multimedia. In this paper, we present a novel framework, named Saliency-Semantic Parsing Re-Identification (SSP-ReID), for taking advantage of the capabilities of both clues: saliency and semantic parsing maps, to guide a backbone convolutional neural network (CNN) to learn complementary representations that improves the results over the original backbones. The insight of fusing multiple clues is based on specific scenarios in which one response is better than another, thus favoring the combination of them to increase performance. Due to its definition, our framework can be easily applied to a wide variety of networks and, in contrast to other competitive methods, our training process follows simple and standard protocols. We present extensive evaluation of our approach through five backbones and three benchmarks. Experimental results demonstrate the effectiveness of our person re-identification framework. In addition, we combine our framework with re-ranking techniques to achieve state-of-the-art results on three benchmarks.

arXiv commentperson re-identification

References in corpus (16)

• In Defense of the Triplet Loss for Person Re-Identification
• Video Salient Object Detection via Fully Convolutional Networks
• DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection
• Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitro
• Performance Measures and a Data Set for Multi-Target, Multi-Camera Tracking
• Harmonious Attention Network for Person Re-Identification
• Deeply-Learned Part-Aligned Representations for Person Re-Identification
• SVDNet for Pedestrian Retrieval
• Re-ranking Person Re-identification with k-reciprocal Encoding
• HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis
• The Devil is in the Middle: Exploiting Mid-level Representations for Cross-Domain Instance Matching
• Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification
• Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing
• Multi-scale Deep Learning Architectures for Person Re-identification
• Resource Aware Person Re-identification across Multiple Resolutions
• Weighted Bilinear Coding over Salient Body Parts for Person Re-identification

Cited by in corpus (5)

• A review of Recent Techniques for Person Re-Identification
• Component-based Attention for Large-scale Trademark Retrieval
• Visual Person Understanding through Multi-Task and Multi-Dataset Learning
• ESA-ReID: Entropy-Based Semantic Feature Alignment for Person re-ID
• Person Re-Identification using Deep Learning Networks: A Systematic Review