CNN-based Methods for Object Recognition with High-Resolution Tactile Sensors
arXiv:2305.12417 · doi:10.1109/JSEN.2019.2912968
Abstract
Novel high-resolution pressure-sensor arrays allow treating pressure readings as standard images. Computer vision algorithms and methods such as Convolutional Neural Networks (CNN) can be used to identify contact objects. In this paper, a high-resolution tactile sensor has been attached to a robotic end-effector to identify contacted objects. Two CNN-based approaches have been employed to classify pressure images. These methods include a transfer learning approach using a pre-trained CNN on an RGB-images dataset and a custom-made CNN (TactNet) trained from scratch with tactile information. The transfer learning approach can be carried out by retraining the classification layers of the network or replacing these layers with an SVM. Overall, 11 configurations based on these methods have been tested: 8 transfer learning-based, and 3 TactNet-based. Moreover, a study of the performance of the methods and a comparative discussion with the current state-of-the-art on tactile object recognition is presented.
References in corpus (5)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- An Analysis of Deep Neural Network Models for Practical Applications
- A Flexible and Robust Large Scale Capacitive Tactile System for Robots
- Quantifying Translation-Invariance in Convolutional Neural Networks
- Iterative Closest Labeled Point for Tactile Object Shape Recognition
Cited by in corpus (6)
- Bayesian and Neural Inference on LSTM-based Object Recognition from Tactile and Kinesthetic Information
- Classification of Vision-Based Tactile Sensors: A Review
- Online Multi-Contact Feedback Model Predictive Control for Interactive Robotic Tasks
- Proprioceptive Sensor-Based Simultaneous Multi-Contact Point Localization and Force Identification for Robotic Arms
- Estimating Perceptual Attributes of Haptic Textures Using Visuo-Tactile Data
- At First Contact: Stiffness Estimation Using Vibrational Information for Prosthetic Grasp Modulation