8 papers
DexVerse: A Modular Benchmark for Multi-Task, Multi-Embodiment Dexterous Manipulation
Yunchao Yao, Zhuxiu Xu, Tianqi Zhang +12
Building general-purpose dexterous manipulation policies requires benchmarks that go beyond isolated tasks to systematically evaluate policies across diverse interaction modes, sen…
OnlineSI: Taming Large Language Model for Online 3D Understanding and Grounding
Zixian Liu, Zhaoxi Chen, Liang Pan +1
In recent years, researchers have increasingly been interested in how to enable Multimodal Large Language Models (MLLM) to possess spatial understanding and reasoning capabilities.…
ViTaS: Visual Tactile Soft Fusion Contrastive Learning for Visuomotor Learning
Yufeng Tian, Shuiqi Cheng, Tianming Wei +6
Tactile information plays a crucial role in human manipulation tasks and has recently garnered increasing attention in robotic manipulation. However, existing approaches mostly foc…
SPIDER: Scalable Physics-Informed Dexterous Retargeting
Chaoyi Pan, Changhao Wang, Haozhi Qi +7
Learning dexterous and agile policy for humanoid and dexterous hand control requires large-scale demonstrations, but collecting robot-specific data is prohibitively expensive. In c…
KGCE: Knowledge-Augmented Dual-Graph Evaluator for Cross-Platform Educational Agent Benchmarking with Multimodal Language Models
Zixian Liu, Sihao Liu, Yuqi Zhao
With the rapid adoption of multimodal large language models (MLMs) in autonomous agents, cross-platform task execution capabilities in educational settings have garnered significan…
Tactile Beyond Pixels: Multisensory Touch Representations for Robot Manipulation
Carolina Higuera, Akash Sharma, Taosha Fan +8
We present Sparsh-X, the first multisensory touch representations across four tactile modalities: image, audio, motion, and pressure. Trained on ~1M contact-rich interactions colle…