Bi-directional Graph Structure Information Model for Multi-Person Pose Estimation

Abstract

In this paper, we propose a novel multi-stage network architecture with two branches in each stage to estimate multi-person poses in images. The first branch predicts the confidence maps of joints and uses a geometrical transform kernel to propagate information between neighboring joints at the confidence level. The second branch proposes a bi-directional graph structure information model (BGSIM) to encode rich contextual information and to infer the occlusion relationship among different joints. We dynamically determine the joint point with highest response of the confidence maps as base point of passing message in BGSIM. Based on the proposed network structure, we achieve an average precision of 62.9 on the COCO Keypoint Challenge dataset and 77.6 on the MPII (multi-person) dataset. Compared with other state-of-art methods, our method can achieve highly promising results on our selected multi-person dataset without extra training.

References in corpus (17)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• DeepPose: Human Pose Estimation via Deep Neural Networks
• Human pose estimation via Convolutional Part Heatmap Regression
• Stacked Hourglass Networks for Human Pose Estimation
• Convolutional Pose Machines
• Learning Human Pose Estimation Features with Convolutional Networks
• AI Challenger : A Large-scale Dataset for Going Deeper in Image Understanding
• DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model
• Fast Tracking via Spatio-Temporal Context Learning
• Towards Accurate Multi-person Pose Estimation in the Wild
• Learning Feature Pyramids for Human Pose Estimation
• RMPE: Regional Multi-person Pose Estimation
• MoDeep: A Deep Learning Framework Using Motion Features for Human Pose Estimation
• An Expressive Deep Model for Human Action Parsing from A Single Image
• Multi-Person Pose Estimation with Local Joint-to-Person Associations
• ArtTrack: Articulated Multi-person Tracking in the Wild
• Joint Graph Decomposition and Node Labeling: Problem, Algorithms, Applications

Cited by in corpus (1)

• Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimation