Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep Reinforcement Learning Approach

Abstract

Industrial robot manipulators are playing a more significant role in modern manufacturing industries. Though peg-in-hole assembly is a common industrial task which has been extensively researched, safely solving complex high precision assembly in an unstructured environment remains an open problem. Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges, especially when using position-controlled manipulators. The main contribution of this work is a learning-based method to solve peg-in-hole tasks with position uncertainty of the hole. We proposed the use of an off-policy model-free reinforcement learning method and bootstrap the training speed by using several transfer learning techniques (sim2real) and domain randomization. Our proposed learning framework for position-controlled robots was extensively evaluated on contact-rich insertion tasks on a variety of environments.

17 pages,12 figures, supplemental video https://youtu.be/v4fREpMk7kU

References in corpus (2)

• Learning Force Control for Contact-rich Manipulation Tasks with Rigid Position-controlled Robots
• Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learning

Cited by in corpus (10)

• Deep Model Predictive Variable Impedance Control
• Visual Spatial Attention and Proprioceptive Data-Driven Reinforcement Learning for Robust Peg-in-Hole Task Under Variable Conditions
• A Versatile Door Opening System with Mobile Manipulator through Adaptive Position-Force Control and Reinforcement Learning
• Contact-rich SE(3)-Equivariant Robot Manipulation Task Learning via Geometric Impedance Control
• Towards Generalized Robot Assembly through Compliance-Enabled Contact Formations
• Learning robotic milling strategies based on passive variable operational space interaction control
• Motion Priority Optimization Framework towards Automated and Teleoperated Robot Cooperation in Industrial Recovery Scenarios
• Neuromorphic force-control in an industrial task: validating energy and latency benefits
• Sustainable Transfer Learning for Adaptive Robot Skills
• Leveraging Procedural Generation for Learning Autonomous Peg-in-Hole Assembly in Space