Model-based Deep Hand Pose Estimation

Abstract

Previous learning based hand pose estimation methods does not fully exploit the prior information in hand model geometry. Instead, they usually rely a separate model fitting step to generate valid hand poses. Such a post processing is inconvenient and sub-optimal. In this work, we propose a model based deep learning approach that adopts a forward kinematics based layer to ensure the geometric validity of estimated poses. For the first time, we show that embedding such a non-linear generative process in deep learning is feasible for hand pose estimation. Our approach is verified on challenging public datasets and achieves state-of-the-art performance.

References in corpus (4)

• Caffe: Convolutional Architecture for Fast Feature Embedding
• Hands Deep in Deep Learning for Hand Pose Estimation
• Depth-based hand pose estimation: methods, data, and challenges
• See the Difference: Direct Pre-Image Reconstruction and Pose Estimation by Differentiating HOG

Cited by in corpus (18)

• Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation
• Fast and Accurate 3D Hand Pose Estimation via Recurrent Neural Network for Capturing Hand Articulations
• Learning to simulate and design for structural engineering
• Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network
• Model-based Hand Pose Estimation for Generalized Hand Shape with Appearance Normalization
• 3D Hand Pose Estimation using Simulation and Partial-Supervision with a Shared Latent Space
• Simultaneous Hand Pose and Skeleton Bone-Lengths Estimation from a Single Depth Image
• JGR-P2O: Joint Graph Reasoning based Pixel-to-Offset Prediction Network for 3D Hand Pose Estimation from a Single Depth Image
• Silhouette-Net: 3D Hand Pose Estimation from Silhouettes
• Deep Kinematic Pose Regression
• Two-hand Global 3D Pose Estimation Using Monocular RGB
• Patch-based 3D Human Pose Refinement
• HMTNet:3D Hand Pose Estimation from Single Depth Image Based on Hand Morphological Topology
• StarMap for Category-Agnostic Keypoint and Viewpoint Estimation
• Serial-parallel Multi-Scale Feature Fusion for Anatomy-Oriented Hand Joint Detection
• Dual Grid Net: hand mesh vertex regression from single depth maps
• Explicit Spatiotemporal Joint Relation Learning for Tracking Human Pose
• HANDS18: Methods, Techniques and Applications for Hand Observation