Hierarchical Policies for Cluttered-Scene Grasping with Latent Plans
arXiv:2107.01518
Abstract
6D grasping in cluttered scenes is a longstanding problem in robotic manipulation. Open-loop manipulation pipelines may fail due to inaccurate state estimation, while most end-to-end grasping methods have not yet scaled to complex scenes with obstacles. In this work, we propose a new method for end-to-end learning of 6D grasping in cluttered scenes. Our hierarchical framework learns collision-free target-driven grasping based on partial point cloud observations. We learn an embedding space to encode expert grasping plans during training and a variational autoencoder to sample diverse grasping trajectories at test time. Furthermore, we train a critic network for plan selection and an option classifier for switching to an instance grasping policy through hierarchical reinforcement learning. We evaluate our method and compare against several baselines in simulation, as well as demonstrate that our latent planning can generalize to real-world cluttered-scene grasping tasks. Our videos and code can be found at https://sites.google.com/view/latent-grasping .
References in corpus (13)
- Adam: A Method for Stochastic Optimization
- Addressing Function Approximation Error in Actor-Critic Methods
- Density estimation using Real NVP
- QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
- Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards
- Visual Reinforcement Learning with Imagined Goals
- Data-Efficient Hierarchical Reinforcement Learning
- InfoGAIL: Interpretable Imitation Learning from Visual Demonstrations
- DART: Noise Injection for Robust Imitation Learning
- Residual Policy Learning
- Parrot: Data-Driven Behavioral Priors for Reinforcement Learning
- Goal-Auxiliary Actor-Critic for 6D Robotic Grasping with Point Clouds
- A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects