3 papers
cs.CL2025
The mutual exclusivity bias of bilingual visually grounded speech models
Dan Oneata, Leanne Nortje, Yevgen Matusevych +1
Mutual exclusivity (ME) is a strategy where a novel word is associated with a novel object rather than a familiar one, facilitating language learning in children. Recent work has f…
cs.CL2024
Improved Visually Prompted Keyword Localisation in Real Low-Resource Settings
Leanne Nortje, Dan Oneata, Gabriel Pirlogeanu +1
Given an image query, visually prompted keyword localisation (VPKL) aims to find occurrences of the depicted word in a speech collection. This can be useful when transcriptions are…
eess.AS2024
Translating speech with just images
Dan Oneata, Herman Kamper
Visually grounded speech models link speech to images. We extend this connection by linking images to text via an existing image captioning system, and as a result gain the ability…