12 papers
Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?
Ta Duc Huy, Trang Nguyen, Townim Chowdhury +5
Vision-language models can produce confident answers on visually ambiguous inputs, resulting in biased predictions. Common entropy-based methods, such as Semantic Entropy (SE), rel…
Beyond the Global Scores: Fine-Grained Token Grounding as a Robust Detector of LVLM Hallucinations
Tuan Dung Nguyen, Minh Khoi Ho, Qi Chen +8
Large vision-language models (LVLMs) achieve strong performance on visual reasoning tasks but remain highly susceptible to hallucination. Existing detection methods predominantly r…
Overthinking Causes Hallucination: Tracing Confounder Propagation in Vision Language Models
Abin Shoby, Ta Duc Huy, Tuan Dung Nguyen +6
Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one mus…
DGRNet: Disagreement-Guided Refinement for Uncertainty-Aware Brain Tumor Segmentation
Bahram Mohammadi, Yanqiu Wu, Vu Minh Hieu Phan +6
Accurate brain tumor segmentation from MRI scans is critical for diagnosis and treatment planning. Despite the strong performance of recent deep learning approaches, two fundamenta…
Hierarchical Text-Guided Brain Tumor Segmentation via Sub-Region-Aware Prompts
Bahram Mohammadi, Ta Duc Huy, Afrouz Sheikholeslami +8
Brain tumor segmentation remains challenging because the three standard sub-regions, i.e., whole tumor (WT), tumor core (TC), and enhancing tumor (ET), often exhibit ambiguous visu…
Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMs
Dung Nguyen, Minh Khoi Ho, Huy Ta +11
Medical Large Multi-modal Models (LMMs) have demonstrated remarkable capabilities in medical data interpretation. However, these models frequently generate hallucinations contradic…