Estimating 6D Pose From Localizing Designated Surface Keypoints

Abstract

In this paper, we present an accurate yet effective solution for 6D pose estimation from an RGB image. The core of our approach is that we first designate a set of surface points on target object model as keypoints and then train a keypoint detector (KPD) to localize them. Finally a PnP algorithm can recover the 6D pose according to the 2D-3D relationship of keypoints. Different from recent state-of-the-art CNN-based approaches that rely on a time-consuming post-processing procedure, our method can achieve competitive accuracy without any refinement after pose prediction. Meanwhile, we obtain a 30% relative improvement in terms of ADD accuracy among methods without using refinement. Moreover, we succeed in handling heavy occlusion by selecting the most confident keypoints to recover the 6D pose. For the sake of reproducibility, we will make our code and models publicly available soon.

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• YOLOv3: An Incremental Improvement
• Deep Residual Learning for Image Recognition
• DeepPose: Human Pose Estimation via Deep Neural Networks
• Stacked Hourglass Networks for Human Pose Estimation
• Convolutional Pose Machines
• Learning Human Pose Estimation Features with Convolutional Networks
• LIFT: Learned Invariant Feature Transform
• 6-DoF Object Pose from Semantic Keypoints
• Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation

Cited by in corpus (5)

• Satellite Pose Estimation Challenge: Dataset, Competition Design and Results
• SuctionNet-1Billion: A Large-Scale Benchmark for Suction Grasping
• Towards Robust Learning-Based Pose Estimation of Noncooperative Spacecraft
• RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images
• Pose Estimation of Specular and Symmetrical Objects