7 papers · 1 filter
PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing
Donghao Zhou, Jia-Hui Pan, Fan Zhang +6
Robotic bin packing requires long-horizon sequential decision-making, as each object placement affects the available space for subsequent packing. Existing methods primarily rely o…
Rethinking Intermediate Representation for VLM-based Robot Manipulation
Weiliang Tang, Jialin Gao, Jia-Hui Pan +6
Vision-Language Model (VLM) is an important component to enable robust robot manipulation. Yet, using it to translate human instructions into an action-resolvable intermediate repr…
Mixture of Horizons in Action Chunking
Dong Jing, Gang Wang, Jiaqi Liu +7
Vision-language-action (VLA) models have shown remarkable capabilities in robotic manipulation, but their performance is sensitive to the used during…
OPA-Pack: Object-Property-Aware Robotic Bin Packing
Jia-Hui Pan, Yeok Tatt Cheah, Zhengzhe Liu +5
Robotic bin packing aids in a wide range of real-world scenarios such as e-commerce and warehouses. Yet, existing works focus mainly on considering the shape of objects to optimize…
GeoManip: Geometric Constraints as General Interfaces for Robot Manipulation
Weiliang Tang, Jia-Hui Pan, Yun-Hui Liu +4
We present GeoManip, a framework to enable generalist robots to leverage essential conditions derived from object and part relationships, as geometric constraints, for robot manipu…
Adapting Segment Anything Model for Unseen Object Instance Segmentation
Rui Cao, Chuanxin Song, Biqi Yang +3
Unseen Object Instance Segmentation (UOIS) is crucial for autonomous robots operating in unstructured environments. Previous approaches require full supervision on large-scale tabl…
Embodiment-Agnostic Action Planning via Object-Part Scene Flow
Weiliang Tang, Jia-Hui Pan, Wei Zhan +6
Observing that the key for robotic action planning is to understand the target-object motion when its associated part is manipulated by the end effector, we propose to generate the…