10 papers
TRAP: Benchmark for Task-completion and Resistance to Active Privacy-extraction
Moon Ye-Bin, Nam Hyeon-Woo, Baek Seong-Eun +2
Agents are increasingly deployed in document-intensive workflows where sensitive private information is not an edge case but a routine input, e.g., an agent booking a flight needs…
Aligning What Vision-Language Models See and Perceive with Adaptive Information Flow
Chengxin Liu, Wonseok Choi, Chenshuang Zhang +1
Vision-Language Models (VLMs) have demonstrated strong capability in a wide range of tasks such as visual recognition, document parsing, and visual grounding. Nevertheless, recent…
Early Failure Detection and Intervention in Video Diffusion Models
Kwon Byung-Ki, Sohwi Lim, Nam Hyeon-Woo +2
Text-to-video (T2V) diffusion models have rapidly advanced, yet generations still occasionally fail in practice, such as low text-video alignment or low perceptual quality. Since d…
Patch-wise Retrieval: A Bag of Practical Techniques for Instance-level Matching
Wonseok Choi, Sohwi Lim, Nam Hyeon-Woo +4
Instance-level image retrieval aims to find images containing the same object as a given query, despite variations in size, position, or appearance. To address this challenging tas…
RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models
Moon Ye-Bin, Roy Miles, Tae-Hyun Oh +2
Image retouching not only enhances visual quality but also serves as a means of expressing personal preferences and emotions. However, existing learning-based approaches require la…
Automated Model Discovery via Multi-modal & Multi-step Pipeline
Lee Jung-Mok, Nam Hyeon-Woo, Moon Ye-Bin +2
Automated model discovery is the process of automatically searching and identifying the most appropriate model for a given dataset over a large combinatorial search space. Existing…
Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation
Lee Chae-Yeon, Nam Hyeon-Woo, Tae-Hyun Oh
3D hand pose estimation is a fundamental task in understanding human hands. However, accurately estimating 3D hand poses remains challenging due to the complex movement of hands, s…
VLM's Eye Examination: Instruct and Inspect Visual Competency of Vision Language Models
Nam Hyeon-Woo, Moon Ye-Bin, Wonseok Choi +2
Vision language models (VLMs) have shown promising reasoning capabilities across various benchmarks; however, our understanding of their visual perception remains limited. In this…
BEAF: Observing BEfore-AFter Changes to Evaluate Hallucination in Vision-language Models
Moon Ye-Bin, Nam Hyeon-Woo, Wonseok Choi +1
Vision language models (VLMs) perceive the world through a combination of a visual encoder and a large language model (LLM). The visual encoder, pre-trained on large-scale vision-t…
SYNAuG: Exploiting Synthetic Data for Data Imbalance Problems
Moon Ye-Bin, Nam Hyeon-Woo, Wonseok Choi +3
Data imbalance in training data often leads to biased predictions from trained models, which in turn causes ethical and social issues. A straightforward solution is to carefully cu…