5 papers · 1 filter
TAP-VLA: Tactile Annotation Prompting for Vision Language Action Models
Mark Van der Merwe, Mohamad Louai Shehab, Jayjun Lee +4
Vision-Language-Action (VLA) models demonstrate impressive reasoning over visual, semantic, and spatial task variations by leveraging large-scale vision and language pre-training.…
Simultaneous Extrinsic Contact and In-Hand Pose Estimation via Distributed Tactile Sensing
Mark Van der Merwe, Kei Ota, Dmitry Berenson +2
Prehensile autonomous manipulation, such as peg insertion, tool use, or assembly, require precise in-hand understanding of the object pose and the extrinsic contacts made during in…
RUMI: Rummaging Using Mutual Information
Sheng Zhong, Nima Fazeli, Dmitry Berenson
This paper presents Rummaging Using Mutual Information (RUMI), a method for online generation of robot action sequences to gather information about the pose of a known movable obje…
Estimating Deformable-Rigid Contact Interactions for a Deformable Tool via Learning and Model-Based Optimization
Mark Van der Merwe, Miquel Oller, Dmitry Berenson +1
Dexterous manipulation requires careful reasoning over extrinsic contacts. The prevalence of deforming tools in human environments, the use of deformable sensors, and the increasin…
Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Control
Miquel Oller, Dmitry Berenson, Nima Fazeli
In this paper, we consider the problem of non-prehensile manipulation using grasped objects. This problem is a superset of many common manipulation skills including instances of to…