9 papers
Token-Based Affordance Grounding with Large Vision-Language Models
Seung Il Lee, Qinqian Lei, Daguang Xu +4
Affordance grounding aims to localize image regions that support a specific action, serving as a core capability for physical intelligence and embodied perception. Previous studies…
CAM3DNet: Comprehensively mining the multi-scale features for 3D Object Detection with Multi-View Cameras
Mingxi Pang, Dingheng Wang, Zekun Li +4
Query-based 3D object detection methods using multi-view images often struggle to efficiently leverage dynamic multi-scale information, e.g., the relationship between the object fe…
A Study of Failure Modes in Two-Stage Human-Object Interaction Detection
Lemeng Wang, Qinqian Lei, Vidhi Bakshi +8
Human-object interaction (HOI) detection aims to detect interactions between humans and objects in images. While recent advances have improved performance on existing benchmarks, t…
UDAPose: Unsupervised Domain Adaptation for Low-Light Human Pose Estimation
Haopeng Chen, Yihao Ai, Kabeen Kim +3
Low-visibility scenarios, such as low-light conditions, pose significant challenges to human pose estimation due to the scarcity of annotated low-light datasets and the loss of vis…
SHOE: Semantic HOI Open-Vocabulary Evaluation Metric
Maja Noack, Qinqian Lei, Taipeng Tian +6
Open-vocabulary human-object interaction (HOI) detection is a step towards building scalable systems that generalize to unseen interactions in real-world scenarios and support grou…
CrossHOI-Bench: A Unified Benchmark for HOI Evaluation across Vision-Language Models and HOI-Specific Methods
Qinqian Lei, Bo Wang, Robby T. Tan
HOI detection has long been dominated by task-specific models, sometimes with early vision-language backbones such as CLIP. With the rise of large generative VLMs, a key question i…