8 citations · 49 across the 40 of their papers we have counts for
8 papers · 1 filter
Attention-Guided Saliency Maps for Interpreting Visualization Literacy in VLMs
Maeve Hutchinson, Abderrahmane Wassim Mehdaoui, Pranava Madhyastha
Understanding how vision-language models (VLMs) interpret data visualizations remains an open problem, and is increasingly important as these models are used for analytical tasks w…
Belief Revision based Caption Re-ranker with Visual Semantic Information
Ahmed Sabir, Francesc Moreno-Noguer, Pranava Madhyastha +1
In this work, we focus on improving the captions generated by image-caption generation systems. We propose a novel re-ranking approach that leverages visual-semantic measures to id…
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish
Begum Citamak, Ozan Caglayan, Menekse Kuyu +4
Automatic generation of video descriptions in natural language, also called video captioning, aims to understand the visual content of the video and produce a natural language sent…
Predicting Language Recovery after Stroke with Convolutional Networks on Stitched MRI
Yusuf H. Roohani, Noor Sajid, Pranava Madhyastha +2
One third of stroke survivors have language difficulties. Emerging evidence suggests that their likelihood of recovery depends mainly on the damage to language centers. Thus previo…
End-to-end Image Captioning Exploits Multimodal Distributional Similarity
Pranava Madhyastha, Josiah Wang, Lucia Specia
We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mappi…
Defoiling Foiled Image Captions
Pranava Madhyastha, Josiah Wang, Lucia Specia
We address the task of detecting foiled image captions, i.e. identifying whether a caption contains a word that has been deliberately replaced by a semantically similar word, thus…
Object Counts! Bringing Explicit Detections Back into Image Captioning
Josiah Wang, Pranava Madhyastha, Lucia Specia
The use of explicit object detectors as an intermediate step to image captioning - which used to constitute an essential stage in early work - is often bypassed in the currently do…
Structured Prediction with Output Embeddings for Semantic Image Annotation
Ariadna Quattoni, Arnau Ramisa, Pranava Swaroop Madhyastha +2
We address the task of annotating images with semantic tuples. Solving this problem requires an algorithm which is able to deal with hundreds of classes for each argument of the tu…