PointNetGPD: Detecting Grasp Configurations from Point Sets
arXiv:1809.06267 · doi:10.1109/ICRA.2019.8794435
Abstract
In this paper, we propose an end-to-end grasp evaluation model to address the challenging problem of localizing robot grasp configurations directly from the point cloud. Compared to recent grasp evaluation metrics that are based on handcrafted depth features and a convolutional neural network (CNN), our proposed PointNetGPD is lightweight and can directly process the 3D point cloud that locates within the gripper for grasp evaluation. Taking the raw point cloud as input, our proposed grasp evaluation network can capture the complex geometric structure of the contact area between the gripper and the object even if the point cloud is very sparse. To further improve our proposed model, we generate a larger-scale grasp dataset with 350k real point cloud and grasps with the YCB object set for training. The performance of the proposed model is quantitatively measured both in simulation and on robotic hardware. Experiments on object grasping and clutter removal show that our proposed model generalizes well to novel objects and outperforms state-of-the-art methods. Code and video are available at \href{https://lianghongzhuo.github.io/PointNetGPD}{https://lianghongzhuo.github.io/PointNetGPD}
arXiv commentAccepted to ICRA 2019. Hongzhuo Liang and Xiaojian Ma contributed equally to this work
References in corpus (1)
Cited by in corpus (17)
- Vision-based Robotic Grasping From Object Localization, Object Pose Estimation to Grasp Estimation for Parallel Grippers: A Review
- TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline
- UniGrasp: Learning a Unified Model to Grasp with Multifingered Robotic Hands
- SuctionNet-1Billion: A Large-Scale Benchmark for Suction Grasping
- Visual Foresight Trees for Object Retrieval from Clutter with Nonprehensile Rearrangement
- Robotic Pick-and-Place With Uncertain Object Instance Segmentation and Shape Completion
- EfficientGrasp: A Unified Data-Efficient Learning to Grasp Method for Multi-fingered Robot Hands
- Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmark
- TransSC: Transformer-based Shape Completion for Grasp Evaluation
- A Survey of Embodied Learning for Object-Centric Robotic Manipulation
- DA Dataset: Toward Dexterity-Aware Dual-Arm Grasping
- Sim-Grasp: Learning 6-DOF Grasp Policies for Cluttered Environments Using a Synthetic Benchmark
- Efficient and Accurate Candidate Generation for Grasp Pose Detection in SE(3)
- Adaptive Grasping of Moving Objects in Dense Clutter via Global-to-Local Detection and Static-to-Dynamic Planning
- PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp
- A Multi-Level Similarity Approach for Single-View Object Grasping: Matching, Planning, and Fine-Tuning
- Dexterous grasp data augmentation based on grasp synthesis with fingertip workspace cloud and contact-aware sampling