478 citations · 905 across the 72 of their papers we have counts for
4 papers · 1 filter
Meshed-Memory Transformer for Image Captioning
Marcella Cornia, Matteo Stefanini, Lorenzo Baraldi +1
Transformer-based architectures represent the state of the art in sequence modeling tasks like machine translation and language understanding. Their applicability to multi-modal co…
Multimodal Attention Networks for Low-Level Vision-and-Language Navigation
Federico Landi, Lorenzo Baraldi, Marcella Cornia +2
Vision-and-Language Navigation (VLN) is a challenging task in which an agent needs to follow a language-specified path to reach a target destination. The goal gets even harder as t…
SMArT: Training Shallow Memory-aware Transformers for Robotic Explainability
Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara
The ability to generate natural language explanations conditioned on the visual perception is a crucial step towards autonomous agents which can explain themselves and communicate…
M-VAD Names: a Dataset for Video Captioning with Naming
Stefano Pini, Marcella Cornia, Federico Bolelli +2
Current movie captioning architectures are not capable of mentioning characters with their proper name, replacing them with a generic "someone" tag. The lack of movie description d…