Densely Semantically Aligned Person Re-Identification

Abstract

We propose a densely semantically aligned person re-identification framework. It fundamentally addresses the body misalignment problem caused by pose/viewpoint variations, imperfect person detection, occlusion, etc. By leveraging the estimation of the dense semantics of a person image, we construct a set of densely semantically aligned part images (DSAP-images), where the same spatial positions have the same semantics across different images. We design a two-stream network that consists of a main full image stream (MF-Stream) and a densely semantically-aligned guiding stream (DSAG-Stream). The DSAG-Stream, with the DSAP-images as input, acts as a regulator to guide the MF-Stream to learn densely semantically aligned features from the original image. In the inference, the DSAG-Stream is discarded and only the MF-Stream is needed, which makes the inference system computationally efficient and robust. To the best of our knowledge, we are the first to make use of fine grained semantics to address the misalignment problems for re-ID. Our method achieves rank-1 accuracy of 78.9% (new protocol) on the CUHK03 dataset, 90.4% on the CUHK01 dataset, and 95.7% on the Market1501 dataset, outperforming state-of-the-art methods.

arXiv commentIEEE Conference on Computer Vision and Pattern Recognition (CVPR2019)

References in corpus (17)

• In Defense of the Triplet Loss for Person Re-Identification
• Person Re-identification: Past, Present and Future
• Improving Person Re-identification by Attribute and Identity Learning
• Random Erasing Data Augmentation
• Pedestrian Alignment Network for Large-scale Person Re-identification
• Deep Representation Learning with Part Loss for Person Re-Identification
• AlignedReID: Surpassing Human-Level Performance in Person Re-Identification
• GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval
• Deep Transfer Learning for Person Re-identification
• PersonNet: Person Re-identification with Deep Convolutional Neural Networks
• Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitro
• Pose Invariant Embedding for Deep Person Re-identification
• Re-ID done right: towards good practices for person re-identification
• Recognizing Partial Biometric Patterns
• Attention-Aware Compositional Network for Person Re-identification
• Deep-Person: Learning Discriminative Deep Features for Person Re-Identification
• MaskReID: A Mask Based Deep Ranking Neural Network for Person Re-identification