DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation

Abstract

Despite decades of research, general purpose in-hand manipulation remains one of the unsolved challenges of robotics. One of the contributing factors that limit current robotic manipulation systems is the difficulty of precisely sensing contact forces -- sensing and reasoning about contact forces are crucial to accurately control interactions with the environment. As a step towards enabling better robotic manipulation, we introduce DIGIT, an inexpensive, compact, and high-resolution tactile sensor geared towards in-hand manipulation. DIGIT improves upon past vision-based tactile sensors by miniaturizing the form factor to be mountable on multi-fingered hands, and by providing several design improvements that result in an easier, more repeatable manufacturing process, and enhanced reliability. We demonstrate the capabilities of the DIGIT sensor by training deep neural network model-based controllers to manipulate glass marbles in-hand with a multi-finger robotic hand. To provide the robotic community access to reliable and low-cost tactile sensors, we open-source the DIGIT design at https://digit.ml/.

arXiv comment8 pages, published in the IEEE Robotics and Automation Letters (RA-L)

References in corpus (2)

• More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch
• Learning Dexterous In-Hand Manipulation

Cited by in corpus (33)

• TACTO: A Fast, Flexible, and Open-source Simulator for High-Resolution Vision-based Tactile Sensors
• Visuo-Haptic Object Perception for Robots: An Overview
• When Vision Meets Touch: A Contemporary Review for Visuotactile Sensors from the Signal Processing Perspective
• Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
• GTac: A Biomimetic Tactile Sensor with Skin-like Heterogeneous Force Feedback for Robots
• AllSight: A Low-Cost and High-Resolution Round Tactile Sensor with Zero-Shot Learning Capability
• Active Multi-Object Exploration and Recognition via Tactile Whiskers
• TacSL: A Library for Visuotactile Sensor Simulation and Learning
• ThinTact:Thin Vision-Based Tactile Sensor by Lensless Imaging
• Classification of Vision-Based Tactile Sensors: A Review
• Proprioceptive Learning with Soft Polyhedral Networks
• MiniTac: An Ultra-Compact 8 mm Vision-Based Tactile Sensor for Enhanced Palpation in Robot-Assisted Minimally Invasive Surgery
• A Survey of Embodied Learning for Object-Centric Robotic Manipulation
• Enhancing Generalizable 6D Pose Tracking of an In-Hand Object with Tactile Sensing
• RAMP: A Benchmark for Evaluating Robotic Assembly Manipulation and Planning
• Controlling diverse robots by inferring Jacobian fields with deep networks
• Telextiles: End-to-end Remote Transmission of Fabric Tactile Sensation
• A Modularized Design Approach for GelSight Family of Vision-based Tactile Sensors
• Vision and Tactile Robotic System to Grasp Litter in Outdoor Environments
• DigiTac: A DIGIT-TacTip Hybrid Tactile Sensor for Comparing Low-Cost High-Resolution Robot Touch
• Grasping Force Estimation for Markerless Visuotactile Sensors
• Visual-tactile manipulation to collect household waste in outdoor
• Single-grasp deformable object discrimination: the effect of gripper morphology, sensing modalities, and action parameters
• NormalFlow: Fast, Robust, and Accurate Contact-based Object 6DoF Pose Tracking with Vision-based Tactile Sensors
• Vision-based Tactile Image Generation via Contact Condition-guided Diffusion Model
• Do Robots Really Need Anthropomorphic Hands? A Comparison of Human and Robotic Hands
• Optimizing BioTac Simulation for Realistic Tactile Perception
• ACROSS: A Deformation-Based Cross-Modal Representation for Robotic Tactile Perception
• SimTac: A Physics-Based Simulator for Vision-Based Tactile Sensing with Biomorphic Structures
• Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network
• SPLIT: Separating Physical-Contact via Latent Arithmetic in Image-Based Tactile Sensors
• Trajectory Optimization for In-Hand Manipulation with Tactile Force Control
• TEXterity -- Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity