6D Rotation Representation For Unconstrained Head Pose Estimation

Abstract

In this paper, we present a method for unconstrained end-to-end head pose estimation. We address the problem of ambiguous rotation labels by introducing the rotation matrix formalism for our ground truth data and propose a continuous 6D rotation matrix representation for efficient and robust direct regression. This way, our method can learn the full rotation appearance which is contrary to previous approaches that restrict the pose prediction to a narrow-angle for satisfactory results. In addition, we propose a geodesic distance-based loss to penalize our network with respect to the SO(3) manifold geometry. Experiments on the public AFLW2000 and BIWI datasets demonstrate that our proposed method significantly outperforms other state-of-the-art methods by up to 20\%. We open-source our training and testing code along with our pre-trained models: https://github.com/thohemp/6DRepNet.

ICIP 2022

Cited by in corpus (7)

• On the representation and methodology for wide and short range head pose estimation
• Automated Deception Detection from Videos: Using End-to-End Learning Based High-Level Features and Classification Approaches
• On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Images
• Sentiment-based Engagement Strategies for intuitive Human-Robot Interaction
• Wrapyfi: A Python Wrapper for Integrating Robots, Sensors, and Applications across Multiple Middleware
• Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors
• End to End Face Reconstruction via Differentiable PnP