6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints
arXiv:1910.10750
Abstract
We present 6-PACK, a deep learning approach to category-level 6D object pose tracking on RGB-D data. Our method tracks in real-time novel object instances of known object categories such as bowls, laptops, and mugs. 6-PACK learns to compactly represent an object by a handful of 3D keypoints, based on which the interframe motion of an object instance can be estimated through keypoint matching. These keypoints are learned end-to-end without manual supervision in order to be most effective for tracking. Our experiments show that our method substantially outperforms existing methods on the NOCS category-level 6D pose estimation benchmark and supports a physical robot to perform simple vision-based closed-loop manipulation tasks. Our code and video are available at https://sites.google.com/view/6packtracking.
References in corpus (8)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Open3D: A Modern Library for 3D Data Processing
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
- DeepIM: Deep Iterative Matching for 6D Pose Estimation
- CornerNet-Lite: Efficient Keypoint Based Object Detection
- Probabilistic Object Tracking using a Range Camera
- PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Tracking
- 6-DoF Object Pose from Semantic Keypoints