Correlating Edge, Pose with Parsing

Abstract

According to existing studies, human body edge and pose are two beneficial factors to human parsing. The effectiveness of each of the high-level features (edge and pose) is confirmed through the concatenation of their features with the parsing features. Driven by the insights, this paper studies how human semantic boundaries and keypoint locations can jointly improve human parsing. Compared with the existing practice of feature concatenation, we find that uncovering the correlation among the three factors is a superior way of leveraging the pivotal contextual cues provided by edges and poses. To capture such correlations, we propose a Correlation Parsing Machine (CorrPM) employing a heterogeneous non-local block to discover the spatial affinity among feature maps from the edge, pose and parsing. The proposed CorrPM allows us to report new state-of-the-art accuracy on three human parsing datasets. Importantly, comparative studies confirm the advantages of feature correlation over the concatenation.

arXiv commentCVPR2020

References in corpus (7)

• Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
• Learning Deconvolution Network for Semantic Segmentation
• Stacked Hourglass Networks for Human Pose Estimation
• Deep High-Resolution Representation Learning for Human Pose Estimation
• Multiple-Human Parsing in the Wild
• Instance-level Human Parsing via Part Grouping Network
• Weakly and Semi Supervised Human Body Part Parsing via Pose-Guided Knowledge Transfer