67 citations · 73 across the 9 of their papers we have counts for
10 papers
Revisiting Compositionality in Dual-Encoder Vision-Language Models: The Role of Inference
Imanol Miranda, Ander Salaberria, Eneko Agirre +1
Dual-encoder Vision-Language Models (VLMs) such as CLIP are often characterized as bag-of-words systems due to their poor performance on compositional benchmarks. We argue that thi…
Multimodal Large Language Models for Low-Resource Languages: A Case Study for Basque
Lukas Arana, Julen Etxaniz, Ander Salaberria +1
Current Multimodal Large Language Models exhibit very strong performance for several demanding tasks. While commercial MLLMs deliver acceptable performance in low-resource language…
Adding simple structure at inference improves Vision-Language Compositionality
Imanol Miranda, Ander Salaberria, Eneko Agirre +1
Dual encoder Vision-Language Models (VLM) such as CLIP are widely used for image-text retrieval tasks. However, those models struggle with compositionality, showing a bag-of-words-…
Vision-Language Models Struggle to Align Entities across Modalities
Iñigo Alonso, Gorka Azkune, Ander Salaberria +2
Cross-modal entity linking refers to the ability to align entities and their attributes across different modalities. While cross-modal entity linking is a fundamental skill needed…
BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval
Imanol Miranda, Ander Salaberria, Eneko Agirre +1
Existing Vision-Language Compositionality (VLC) benchmarks like SugarCrepe are formulated as image-to-text retrieval problems, where, given an image, the models need to select betw…
Grounding Spatial Relations in Text-Only Language Models
Gorka Azkune, Ander Salaberria, Eneko Agirre
This paper shows that text-only Language Models (LM) can learn to ground spatial relations like "left of" or "below" if they are provided with explicit location information of obje…
Improving Explicit Spatial Relationships in Text-to-Image Generation through an Automatically Derived Dataset
Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle +3
Existing work has observed that current text-to-image systems do not accurately reflect explicit spatial relations between objects such as 'left of' or 'below'. We hypothesize that…
IXA/Cogcomp at SemEval-2023 Task 2: Context-enriched Multilingual Named Entity Recognition using Knowledge Bases
Iker García-Ferrero, Jon Ander Campos, Oscar Sainz +2
Named Entity Recognition (NER) is a core natural language processing task in which pre-trained language models have shown remarkable performance. However, standard benchmarks like…
Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering
Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle +2
Integrating outside knowledge for reasoning in visio-linguistic tasks such as visual question answering (VQA) is an open problem. Given that pretrained language models have been sh…
Evaluating Multimodal Representations on Visual Semantic Textual Similarity
Oier Lopez de Lacalle, Ander Salaberria, Aitor Soroa +2
The combination of visual and textual representations has produced excellent results in tasks such as image captioning and visual question answering, but the inference capabilities…