6 papers
HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning
Amirhosein Alian, Yongqiang Zhao, Shiyi Gu +5
Despite the importance of tactile sensing for reliable manipulation, most existing Vision-Language-Action (VLA) datasets remain vision-only, and those that do incorporate tactile i…
Visual-Tactile Peg-in-Hole Assembly Learning from Peg-out-of-Hole Disassembly
Yongqiang Zhao, Xuyang Zhang, Zhuo Chen +3
Peg-in-hole (PiH) assembly is a fundamental yet challenging robotic manipulation task. While reinforcement learning (RL) has shown promise in tackling such tasks, it requires exten…
SimTac: A Physics-Based Simulator for Vision-Based Tactile Sensing with Biomorphic Structures
Xuyang Zhang, Jiaqi Jiang, Zhuo Chen +5
Tactile sensing in biological organisms is deeply intertwined with morphological form, such as human fingers, cat paws, and elephant trunks, which enables rich and adaptive interac…
ViTacGen: Robotic Pushing with Vision-to-Touch Generation
Zhiyuan Wu, Yijiong Lin, Yongqiang Zhao +4
Robotic pushing is a fundamental manipulation task that requires tactile feedback to capture subtle contact forces and dynamics between the end-effector and the object. However, re…
ConViTac: Aligning Visual-Tactile Fusion with Contrastive Representations
Zhiyuan Wu, Yongqiang Zhao, Shan Luo
Vision and touch are two fundamental sensory modalities for robots, offering complementary information that enhances perception and manipulation tasks. Previous research has attemp…
Training Tactile Sensors to Learn Force Sensing from Each Other
Zhuo Chen, Ni Ou, Xuyang Zhang +8
Humans achieve stable and dexterous object manipulation by coordinating grasp forces across multiple fingers and palms, facilitated by a unified tactile memory system in the somato…