1 citations · 1 across the 7 of their papers we have counts for
9 papers
Chain-of-Caption: Training-free improvement of multimodal large language model on referring expression comprehension
Yik Lung Pang, Changjae Oh
Given a textual description, the task of referring expression comprehension (REC) involves the localisation of the referred object in an image. Multimodal large language models (ML…
LaVA-Man: Learning Visual Action Representations for Robot Manipulation
Chaoran Zhu, Hengyi Wang, Yik Lung Pang +1
Visual-textual understanding is essential for language-guided robot manipulation. Recent works leverage pre-trained vision-language models to measure the similarity between encoded…
Toward Human-Robot Teaming: Learning Handover Behaviors from 3D Scenes
Yuekun Wu, Yik Lung Pang, Andrea Cavallaro +1
Human-robot teaming (HRT) systems often rely on large-scale datasets of human and robot interactions, especially for close-proximity collaboration tasks such as human-robot handove…
Learning human-to-robot handovers through 3D scene reconstruction
Yuekun Wu, Yik Lung Pang, Andrea Cavallaro +1
Learning robot manipulation policies from raw, real-world image data requires a large number of robot-action trials in the physical environment. Although training using simulations…
Stereo Hand-Object Reconstruction for Human-to-Robot Handover
Yik Lung Pang, Alessio Xompero, Changjae Oh +1
Jointly estimating hand and object shape facilitates the grasping task in human-to-robot handovers. However, relying on hand-crafted prior knowledge about the geometric structure o…
Sparse multi-view hand-object reconstruction for unseen environments
Yik Lung Pang, Changjae Oh, Andrea Cavallaro
Recent works in hand-object reconstruction mainly focus on the single-view and dense multi-view settings. On the one hand, single-view methods can leverage learned shape priors to…
Audio-Visual Object Classification for Human-Robot Collaboration
A. Xompero, Y. L. Pang, T. Patten +3
Human-robot collaboration requires the contactless estimation of the physical properties of containers manipulated by a person, for example while pouring content in a cup or moving…
OHPL: One-shot Hand-eye Policy Learner
Changjae Oh, Yik Lung Pang, Andrea Cavallaro
The control of a robot for manipulation tasks generally relies on object detection and pose estimation. An attractive alternative is to learn control policies directly from raw inp…
Towards safe human-to-robot handovers of unknown containers
Yik Lung Pang, Alessio Xompero, Changjae Oh +1
Safe human-to-robot handovers of unknown objects require accurate estimation of hand poses and object properties, such as shape, trajectory, and weight. Accurately estimating these…