90 citations · 144 across the 12 of their papers we have counts for
4 papers · 1 filter
On Architectures for Including Visual Information in Neural Language Models for Image Description
Marc Tanti, Albert Gatt, Kenneth P. Camilleri
A neural language model can be conditioned into generating descriptions for images by providing visual information apart from the sentence prefix. This visual information can be in…
Quantifying the amount of visual information used by neural caption generators
Marc Tanti, Albert Gatt, Kenneth P. Camilleri
This paper addresses the sensitivity of neural image caption generators to their visual input. A sensitivity analysis and omission analysis based on image foils is reported, showin…
Pre-gen metrics: Predicting caption quality metrics without generating captions
Marc Tanti, Albert Gatt, Adrian Muscat
Image caption generation systems are typically evaluated against reference outputs. We show that it is possible to predict output quality without generating the captions, based on…
Where to put the Image in an Image Caption Generator
Marc Tanti, Albert Gatt, Kenneth P. Camilleri
When a recurrent neural network language model is used for caption generation, the image information can be fed to the neural network either by directly incorporating it in the RNN…