Multi-task Learning with Coarse Priors for Robust Part-aware Person Re-identification
arXiv:2003.08069 · doi:10.1109/TPAMI.2020.3024900
Abstract
Part-level representations are important for robust person re-identification (ReID), but in practice feature quality suffers due to the body part misalignment problem. In this paper, we present a robust, compact, and easy-to-use method called the Multi-task Part-aware Network (MPN), which is designed to extract semantically aligned part-level features from pedestrian images. MPN solves the body part misalignment problem via multi-task learning (MTL) in the training stage. More specifically, it builds one main task (MT) and one auxiliary task (AT) for each body part on the top of the same backbone model. The ATs are equipped with a coarse prior of the body part locations for training images. ATs then transfer the concept of the body parts to the MTs via optimizing the MT parameters to identify part-relevant channels from the backbone model. Concept transfer is accomplished by means of two novel alignment strategies: namely, parameter space alignment via hard parameter sharing and feature space alignment in a class-wise manner. With the aid of the learned high-quality parameters, MTs can independently extract semantically aligned part-level features from relevant channels in the testing stage. MPN has three key advantages: 1) it does not need to conduct body part detection in the inference stage; 2) its model is very compact and efficient for both training and testing; 3) in the training stage, it requires only coarse priors of body part locations, which are easy to obtain. Systematic experiments on four large-scale ReID databases demonstrate that MPN consistently outperforms state-of-the-art approaches by significant margins. Code is available at https://github.com/WangKan0128/MPN.
arXiv commentAccepted Version to IEEE Transactions on Pattern Analysis and Machine Intelligence
References in corpus (22)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- In Defense of the Triplet Loss for Person Re-Identification
- Learning Transferable Features with Deep Adaptation Networks
- An Overview of Multi-Task Learning in Deep Neural Networks
- Squeeze-and-Excitation Networks
- Learning Discriminative Features with Multiple Granularities for Person Re-Identification
- Person Re-identification: Past, Present and Future
- A Discriminatively Learned CNN Embedding for Person Re-identification
- Random Erasing Data Augmentation
- Pedestrian Alignment Network for Large-scale Person Re-identification
- Deep Representation Learning with Part Loss for Person Re-Identification
- AlignedReID: Surpassing Human-Level Performance in Person Re-Identification
- GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval
- Person Re-Identification by Camera Correlation Aware Feature Augmentation
- SVDNet for Pedestrian Retrieval
- Part-based Deep Hashing for Large-scale Person Re-identification
- Discriminative Feature Learning with Foreground Attention for Person Re-Identification
- Relation-Aware Global Attention for Person Re-identification
- CDPM: Convolutional Deformable Part Models for Semantically Aligned Person Re-identification
- Resource Aware Person Re-identification across Multiple Resolutions
- Factorized Distillation: Training Holistic Person Re-identification Model by Distilling an Ensemble of Partial ReID Models
Cited by in corpus (6)
- Semantically Self-Aligned Network for Text-to-Image Part-aware Person Re-identification
- Batch Coherence-Driven Network for Part-aware Person Re-Identification
- Prototype-guided Cross-modal Completion and Alignment for Incomplete Text-based Person Re-identification
- G2DA: Geometry-Guided Dual-Alignment Learning for RGB-Infrared Person Re-Identification
- Attention-guided Progressive Mapping for Profile Face Recognition
- Learning Task-preferred Inference Routes for Gradient De-conflict in Multi-output DNNs