Perceive Where to Focus: Learning Visibility-aware Part-level Features for Partial Person Re-identification

Abstract

This paper considers a realistic problem in person re-identification (re-ID) task, i.e., partial re-ID. Under partial re-ID scenario, the images may contain a partial observation of a pedestrian. If we directly compare a partial pedestrian image with a holistic one, the extreme spatial misalignment significantly compromises the discriminative ability of the learned representation. We propose a Visibility-aware Part Model (VPM), which learns to perceive the visibility of regions through self-supervision. The visibility awareness allows VPM to extract region-level features and compare two images with focus on their shared regions (which are visible on both images). VPM gains two-fold benefit toward higher accuracy for partial re-ID. On the one hand, compared with learning a global feature, VPM learns region-level features and benefits from fine-grained information. On the other hand, with visibility awareness, VPM is capable to estimate the shared regions between two images and thus suppresses the spatial misalignment. Experimental results confirm that our method significantly improves the learned representation and the achieved accuracy is on par with the state of the art.

8 pages, 5 figures, accepted by CVPR2019

References in corpus (16)

• Deep Residual Learning for Image Recognition
• Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
• In Defense of the Triplet Loss for Person Re-Identification
• Person Re-identification: Past, Present and Future
• Fully Convolutional Networks for Semantic Segmentation
• Stacked Hourglass Networks for Human Pose Estimation
• Deep Representation Learning with Part Loss for Person Re-Identification
• AlignedReID: Surpassing Human-Level Performance in Person Re-Identification
• GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval
• Convolutional Pose Machines
• Unsupervised Visual Representation Learning by Context Prediction
• Building high-level features using large scale unsupervised learning
• Learning Representations for Automatic Colorization
• HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis
• Recognizing Partial Biometric Patterns
• Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing