Deep Learning-Based Human Pose Estimation: A Survey

Abstract

Human pose estimation aims to locate the human body parts and build human body representation (e.g., body skeleton) from input data such as images and videos. It has drawn increasing attention during the past decade and has been utilized in a wide range of applications including human-computer interaction, motion analysis, augmented reality, and virtual reality. Although the recently developed deep learning-based solutions have achieved high performance in human pose estimation, there still remain challenges due to insufficient training data, depth ambiguities, and occlusion. The goal of this survey paper is to provide a comprehensive review of recent deep learning-based solutions for both 2D and 3D pose estimation via a systematic analysis and comparison of these solutions based on their input data and inference procedures. More than 250 research papers since 2014 are covered in this survey. Furthermore, 2D and 3D human pose estimation datasets and evaluation metrics are included. Quantitative performance comparisons of the reviewed methods on popular datasets are summarized and discussed. Finally, the challenges involved, applications, and future research directions are concluded. A regularly updated project page is provided: \url{https://github.com/zczcwh/DL-HPE}

References in corpus (12)

• An Overview of Multi-Task Learning in Deep Neural Networks
• Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
• Monocular Human Pose Estimation: A Survey of Deep Learning-based Methods
• Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relations
• Human Pose Regression by Combining Indirect Part Detection and Contextual Information
• AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild
• Rethinking on Multi-Stage Networks for Human Pose Estimation
• DirectPose: Direct End-to-End Multi-Person Pose Estimation
• Human Pose Estimation with Spatial Contextual Information
• Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learning
• AutoPose: Searching Multi-Scale Branch Aggregation for Pose Estimation
• A novel joint points and silhouette-based method to estimate 3D human pose and shape

Cited by in corpus (9)

• All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda
• AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild
• Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Models
• End-to-End Trainable Multi-Instance Pose Estimation with Transformers
• Continual Learning from Synthetic Data for a Humanoid Exercise Robot
• DynaDog+T: A Parametric Animal Model for Synthetic Canine Image Generation
• Neural Network Based Lidar Gesture Recognition for Realtime Robot Teleoperation
• The Influence of Faulty Labels in Data Sets on Human Pose Estimation
• KeyCLD: Learning Constrained Lagrangian Dynamics in Keypoint Coordinates from Images