16 papers
AVT-Fabric: Active Visuo-Tactile Perception via Adaptive Evidence Selection for Efficient Robotic Fabric Comparison
Chang Gao, Zhuo Chen, Suhang Xia +3
Robotic fabric comparison needs to actively combine visual appearance and tactile cues. Here, we present AVT-Fabric, an RGB-first framework that allocates tactile evidence accordin…
VTLoc: Learning-based Tactile Contact Localization in Visual Point Clouds
Zhiyuan Wu, Zhuo Chen, Shan Luo
Vision and touch are complementary modalities essential for robotic perception and manipulation. While vision provides global object context, touch offers precise local information…
HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning
Amirhosein Alian, Yongqiang Zhao, Shiyi Gu +5
Despite the importance of tactile sensing for reliable manipulation, most existing Vision-Language-Action (VLA) datasets remain vision-only, and those that do incorporate tactile i…
Visual-Tactile Peg-in-Hole Assembly Learning from Peg-out-of-Hole Disassembly
Yongqiang Zhao, Xuyang Zhang, Zhuo Chen +3
Peg-in-hole (PiH) assembly is a fundamental yet challenging robotic manipulation task. While reinforcement learning (RL) has shown promise in tackling such tasks, it requires exten…
UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors
Zhuo Chen, Fei Ni, Kaiyao Luo +7
Force sensing is essential for dexterous robot manipulation, but scaling force-aware policy learning is hindered by the heterogeneity of tactile sensors. Differences in sensing pri…
DiffMorphGrasp: A Diffusion Framework Conditioned on Hand Morphology for Cross-Embodiment Grasp Generation
Zhiyuan Wu, Xiangyu Zhang, Zhuo Chen +3
As robots are deployed across diverse environments, manipulation tasks require robot hands with different morphologies to satisfy varying task requirements, hardware capabilities,…
MagicSkin: Balancing Marker and Markerless Modes in Vision-Based Tactile Sensors with a Translucent Skin
Oluwatimilehin Tijani, Zhuo Chen, Jiankang Deng +1
Vision-based tactile sensors (VBTS) face a fundamental trade-off in marker and markerless design on the tactile skin: opaque ink markers enable measurement of force and tangential…
Force-Aware 3D Contact Modeling for Stable Grasp Generation
Zhuo Chen, Zhongqun Zhang, Yihua Cheng +2
Contact-based grasp generation plays a crucial role in various applications. Recent methods typically focus on the geometric structure of objects, producing grasps with diverse han…
SimTac: A Physics-Based Simulator for Vision-Based Tactile Sensing with Biomorphic Structures
Xuyang Zhang, Jiaqi Jiang, Zhuo Chen +5
Tactile sensing in biological organisms is deeply intertwined with morphological form, such as human fingers, cat paws, and elephant trunks, which enables rich and adaptive interac…
ViTacGen: Robotic Pushing with Vision-to-Touch Generation
Zhiyuan Wu, Yijiong Lin, Yongqiang Zhao +4
Robotic pushing is a fundamental manipulation task that requires tactile feedback to capture subtle contact forces and dynamics between the end-effector and the object. However, re…
Iterative Camera-LiDAR Extrinsic Optimization via Surrogate Diffusion
Ni Ou, Zhuo Chen, Xinru Zhang +1
Cameras and LiDAR are essential sensors for autonomous vehicles. The fusion of camera and LiDAR data addresses the limitations of individual sensors but relies on precise extrinsic…
Training Tactile Sensors to Learn Force Sensing from Each Other
Zhuo Chen, Ni Ou, Xuyang Zhang +8
Humans achieve stable and dexterous object manipulation by coordinating grasp forces across multiple fingers and palms, facilitated by a unified tactile memory system in the somato…
Iterative Camera-LiDAR Extrinsic Optimization via Surrogate Diffusion
Ni Ou, Zhuo Chen, Xinru Zhang +1
Cameras and LiDAR are essential sensors for autonomous vehicles. Camera-LiDAR data fusion compensate for deficiencies of stand-alone sensors but relies on precise extrinsic calibra…
TransForce: Transferable Force Prediction for Vision-based Tactile Sensors with Sequential Image Translation
Zhuo Chen, Ni Ou, Xuyang Zhang +1
Vision-based tactile sensors (VBTSs) provide high-resolution tactile images crucial for robot in-hand manipulation. However, force sensing in VBTSs is underutilized due to the cost…
Marker or Markerless? Mode-Switchable Optical Tactile Sensing for Diverse Robot Tasks
Ni Ou, Zhuo Chen, Shan Luo
Optical tactile sensors play a pivotal role in robot perception and manipulation tasks. The membrane of these sensors can be painted with markers or remain markerless, enabling the…
Deep Domain Adaptation Regression for Force Calibration of Optical Tactile Sensors
Zhuo Chen, Ni Ou, Jiaqi Jiang +1
Optical tactile sensors provide robots with rich force information for robot grasping in unstructured environments. The fast and accurate calibration of three-dimensional contact f…