1 citations · 3 across the 13 of their papers we have counts for
13 papers
Context-structured Video Anomaly Detection with Large Vision-Language Models
Dongjun Kim, Changjae Oh, Andrea Cavallaro +1
Training video anomaly detectors is challenging due to the difficulty and cost of annotating diverse and rare abnormal events. Although recent large vision-language models enable t…
FlowOVD: Learning Generative Latent Flows for Zero-shot Open-vocabulary Detection
Yao Wei, Andrea Cavallaro, Changjae Oh
Open-vocabulary object detection (OVD) has achieved remarkable progress through large-scale vision-language pre-training. Existing methods, however, typically formulate OVD as a di…
The Detector Teaches Itself: Lightweight Self-Supervised Adaptation for Open-Vocabulary Object Detection
Yazhe Wan, Changjae Oh
Open-vocabulary object detection aims to recognize objects from an open set of categories, which leverages vision-language models (VLMs) pre-trained on large-scale image-text data.…
Chain-of-Caption: Training-free improvement of multimodal large language model on referring expression comprehension
Yik Lung Pang, Changjae Oh
Given a textual description, the task of referring expression comprehension (REC) involves the localisation of the referred object in an image. Multimodal large language models (ML…
AutoMV: An Automatic Multi-Agent System for Music Video Generation
Xiaoxuan Tang, Xinping Lei, Chaoran Zhu +10
Music-to-Video (M2V) generation for full-length songs faces significant challenges. Existing methods produce short, disjointed clips, failing to align visuals with musical structur…
LaVA-Man: Learning Visual Action Representations for Robot Manipulation
Chaoran Zhu, Hengyi Wang, Yik Lung Pang +1
Visual-textual understanding is essential for language-guided robot manipulation. Recent works leverage pre-trained vision-language models to measure the similarity between encoded…
Toward Human-Robot Teaming: Learning Handover Behaviors from 3D Scenes
Yuekun Wu, Yik Lung Pang, Andrea Cavallaro +1
Human-robot teaming (HRT) systems often rely on large-scale datasets of human and robot interactions, especially for close-proximity collaboration tasks such as human-robot handove…
Improving Generalization of Language-Conditioned Robot Manipulation
Chenglin Cui, Chaoran Zhu, Changjae Oh +1
The control of robots for manipulation tasks generally relies on visual input. Recent advances in vision-language models (VLMs) enable the use of natural language instructions to c…
Learning human-to-robot handovers through 3D scene reconstruction
Yuekun Wu, Yik Lung Pang, Andrea Cavallaro +1
Learning robot manipulation policies from raw, real-world image data requires a large number of robot-action trials in the physical environment. Although training using simulations…
Stereo Hand-Object Reconstruction for Human-to-Robot Handover
Yik Lung Pang, Alessio Xompero, Changjae Oh +1
Jointly estimating hand and object shape facilitates the grasping task in human-to-robot handovers. However, relying on hand-crafted prior knowledge about the geometric structure o…
High-resolution open-vocabulary object 6D pose estimation
Jaime Corsetti, Davide Boscaini, Francesco Giuliari +3
The generalisation to unseen objects in the 6D pose estimation task is very challenging. While Vision-Language Models (VLMs) enable using natural language descriptions to support 6…
Sparse multi-view hand-object reconstruction for unseen environments
Yik Lung Pang, Changjae Oh, Andrea Cavallaro
Recent works in hand-object reconstruction mainly focus on the single-view and dense multi-view settings. On the one hand, single-view methods can leverage learned shape priors to…
Open-vocabulary object 6D pose estimation
Jaime Corsetti, Davide Boscaini, Changjae Oh +2
We introduce the new setting of open-vocabulary object 6D pose estimation, in which a textual prompt is used to specify the object of interest. In contrast to existing approaches,…