8 papers
Skel-WAM: A Hand-Skeleton-Conditioned World Action Model for Human-to-Robot Manipulation Transfer
Zetao Cai, Yaping Li, Yiqun Wang +8
Robot demonstrations are expensive to collect and often provide limited distributional coverage of task variations. Human videos offer a low-cost source of complementary manipulati…
Grounding Generative Policies in Physics: Optimization-Guided Diffusion for Robot Control
Sabrina Bodmer, René Zurbrügg, Tifanny Portela +5
Diffusion models sample effectively from high-dimensional, multimodal distributions, but their outputs may violate deployment constraints. For task-space robot policies, generated…
EBench: Elemental Diagnosis of Generalist Mobile Manipulation Policies
Ning Gao, Jinliang Zheng, Xing Gao +22
We present EBench, a simulation benchmark that diagnoses generalist mobile manipulation policies beyond a single success-rate scalar. EBench comprises 26 diverse and challenging ma…
EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesis
Xiefan Guo, Xinzhu Ma, Haoxiang Ma +2
Text-to-image diffusion models have achieved remarkable fidelity in synthesizing images from explicit text prompts, yet exhibit a critical deficiency in processing implicit prompts…
GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion
Enda Xiang, Haoxiang Ma, Xinzhu Ma +2
This paper focuses on enhancing the grasping precision and generalization of manipulation policies learned via imitation learning. Diffusion-based policy learning methods have rece…
Generalizing 6-DoF Grasp Detection via Domain Prior Knowledge
Haoxiang Ma, Modi Shi, Boyang Gao +1
We focus on the generalization ability of the 6-DoF grasp detection method in this paper. While learning-based grasp detection methods can predict grasp poses for unseen objects us…
Sim-to-Real Grasp Detection with Global-to-Local RGB-D Adaptation
Haoxiang Ma, Ran Qin, Modi shi +2
This paper focuses on the sim-to-real issue of RGB-D grasp detection and formulates it as a domain adaptation problem. In this case, we present a global-to-local method to address…
Towards Generalizable Referring Image Segmentation via Target Prompt and Visual Coherence
Yajie Liu, Pu Ge, Haoxiang Ma +4
Referring image segmentation (RIS) aims to segment objects in an image conditioning on free-from text descriptions. Despite the overwhelming progress, it still remains challenging…