DeepClaw: A Robotic Hardware Benchmarking Platform for Learning Object Manipulation
arXiv:2005.02588
Abstract
We present DeepClaw as a reconfigurable benchmark of robotic hardware and task hierarchy for robot learning. The DeepClaw benchmark aims at a mechatronics perspective of the robot learning problem, which features a minimum design of robot cell that can be easily reconfigured to host robot hardware from various vendors, including manipulators, grippers, cameras, desks, and objects, aiming at a streamlined collection of physical manipulation data and evaluation of the learned skills for hardware benchmarking. We provide a detailed design of the robot cell with readily available parts to build the experiment environment that can host a wide range of robotic hardware commonly adopted for robot learning. We also propose a hierarchical pipeline of software integration, including localization, recognition, grasp planning, and motion planning, to streamline learning-based robot control, data collection, and experiment validation towards shareability and reproducibility. We present benchmarking results of the DeepClaw system for a baseline Tic-Tac-Toe task, a bin-clearing task, and a jigsaw puzzle task using three sets of standard robotic hardware. Our results show that tasks defined in DeepClaw can be easily reproduced on three robot cells. Under the same task setup, the differences in robotic hardware used will present a non-negligible impact on the performance metrics of robot learning. All design layouts and codes are hosted on Github for open access.
13 pages, 6 figures, 2 tables, accepted for AIM 2020
References in corpus (8)
- Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
- Solving Rubik's Cube with a Robot Hand
- Benchmarking in Manipulation Research: The YCB Object and Model Set and Benchmarking Protocols
- Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metrics
- Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Task
- RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation
- REPLAB: A Reproducible Low-Cost Arm Benchmark Platform for Robotic Learning
- ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots