187 citations · 475 across the 25 of their papers we have counts for
3 papers · 1 filter
The Role of Data Curation in Image Captioning
Wenyan Li, Jonas F. Lotz, Chen Qiu +1
Image captioning models are typically trained by treating all samples equally, neglecting to account for mismatched or otherwise difficult data points. In contrast, recent work has…
Retrieval-augmented Image Captioning
Rita Ramos, Desmond Elliott, Bruno Martins
Inspired by retrieval-augmented language generation and pretrained Vision and Language (V&L) encoders, we present a new approach to image captioning that generates sentences given…
SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
Rita Ramos, Bruno Martins, Desmond Elliott +1
Recent advances in image captioning have focused on scaling the data and model size, substantially increasing the cost of pre-training and finetuning. As an alternative to large mo…