Bandit-Based Model Selection for Deformable Object Manipulation

Abstract

We present a novel approach to deformable object manipulation that does not rely on highly-accurate modeling. The key contribution of this paper is to formulate the task as a Multi-Armed Bandit problem, with each arm representing a model of the deformable object. To "pull" an arm and evaluate its utility, we use the arm's model to generate a velocity command for the gripper(s) holding the object and execute it. As the task proceeds and the object deforms, the utility of each model can change. Our framework estimates these changes and balances exploration of the model set with exploitation of high-utility models. We also propose an approach based on Kalman Filtering for Non-stationary Multi-armed Normal Bandits (KF-MANB) to leverage the coupling between models to learn more from each arm pull. We demonstrate that our method outperforms previous methods on synthetic trials, and performs competitively on several manipulation tasks in simulation.

Presented at the Workshop on the Algorithmic Foundations of Robotics, 2016, San Francisco, CA

References in corpus (1)

• Bandit-Based Model Selection for Deformable Object Manipulation

Cited by in corpus (7)

• Bandit-Based Model Selection for Deformable Object Manipulation
• Learning-based Feedback Controller for Deformable Object Manipulation
• Manipulating Highly Deformable Materials Using a Visual Feedback Dictionary
• Accelerated learning from recommender systems using multi-armed bandit
• Automated Plan Refinement for Improving Efficiency of Robotic Layup of Composite Sheets
• TAMPC: A Controller for Escaping Traps in Novel Environments
• 3D Deformable Object Manipulation using Fast Online Gaussian Process Regression