Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relations

Abstract

We present a method for estimating articulated human pose from a single static image based on a graphical model with novel pairwise relations that make adaptive use of local image measurements. More precisely, we specify a graphical model for human pose which exploits the fact the local image measurements can be used both to detect parts (or joints) and also to predict the spatial relationships between them (Image Dependent Pairwise Relations). These spatial relationships are represented by a mixture model. We use Deep Convolutional Neural Networks (DCNNs) to learn conditional probabilities for the presence of parts and their spatial relationships within image patches. Hence our model combines the representational flexibility of graphical models with the efficiency and statistical power of DCNNs. Our method significantly outperforms the state of the art methods on the LSP and FLIC datasets and also performs very well on the Buffy dataset without any training.

NIPS 2014 Camera Ready

References in corpus (1)

• Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Parts

Cited by in corpus (21)

• Monocular Human Pose Estimation: A Survey of Deep Learning-based Methods
• Deep High-Resolution Representation Learning for Human Pose Estimation
• Distribution-Aware Coordinate Representation for Human Pose Estimation
• Person-in-WiFi: Fine-grained Person Perception using WiFi
• Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimation
• Graph-PCNN: Two Stage Human Pose Estimation with Graph Pose Refinement
• Automatic Calibration of a Six-Degrees-of-Freedom Pose Estimation System
• Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation
• Deep Metric Learning Beyond Binary Supervision
• Feature Boosting Network For 3D Pose Estimation
• DeepFuse: An IMU-Aware Network for Real-Time 3D Human Pose Estimation from Multi-View Image
• From Kinematics To Dynamics: Estimating Center of Pressure and Base of Support from Video Frames of Human Motion
• Rotation-invariant Mixed Graphical Model Network for 2D Hand Pose Estimation
• Context Modeling in 3D Human Pose Estimation: A Unified Perspective
• Single Person Pose Estimation: A Survey
• Patch-based 3D Human Pose Refinement
• Key Frame Proposal Network for Efficient Pose Estimation in Videos
• Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation
• Semi- and Weakly-supervised Human Pose Estimation
• Layout-Graph Reasoning for Fashion Landmark Detection
• Symmetric Non-Rigid Structure from Motion for Category-Specific Object Structure Estimation