8 papers
MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation
Yuxin Jiang, Chang Yu, Yunuo Chen +4
Video-world-model policies learn action-relevant representations by predicting future observations. However, they condition on only a short observation window, which renders long-h…
Sparse2Act: Learning Action-Aligned Sparse 3D Representations for Cross-Domain Robot Manipulation
Yu Guo, Chang Yu, Siyu Ma +4
Explicit 3D representations are attractive for manipulation because they expose object shape, workspace geometry, and robot-object relations in metric coordinates. However, sparse…
TacCoRL: Integrating Tactile Feedback into VLA via Simulation
Siyu Ma, Yuqi Liang, Chang Yu +5
Vision-language-action (VLA) models provide strong visual, language, and action priors for robot manipulation, but visual observations alone often miss the local contact state requ…
Right-Side-Out: Learning Zero-Shot Sim-to-Real Garment Reversal
Chang Yu, Siyu Ma, Wenxin Du +9
Turning garments right-side out is a challenging manipulation task: it is highly dynamic, entails rapid contact changes, and is subject to severe visual occlusion. We introduce Rig…
Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation
Yuyang Li, Wenxin Du, Chang Yu +6
Tactile sensing is crucial for achieving human-level robotic capabilities in manipulation tasks. As a promising solution, Vision-Based Tactile Sensors (VBTSs) offer high spatial re…
A Convex Formulation of Material Points and Rigid Bodies with GPU-Accelerated Async-Coupling for Interactive Simulation
Chang Yu, Wenxin Du, Zeshun Zong +3
We present a novel convex formulation that weakly couples the Material Point Method (MPM) with rigid body dynamics through frictional contact, optimized for efficient GPU paralleli…