4 papers
StoryMovie: A Dataset for Semantic Alignment of Visual Stories with Movie Scripts and Subtitles
Daniel Oliveira, David Martins de Matos
Visual storytelling models that correctly ground entities in images may still hallucinate semantic relationships, generating incorrect dialogue attribution, character interactions,…
StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story Generation
Daniel A. P. Oliveira, David Martins de Matos
Visual storytelling systems struggle to maintain character identity across frames and link actions to appropriate subjects, frequently leading to referential hallucinations. These…
Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges
Daniel A. P. Oliveira, Eugénio Ribeiro, David Martins de Matos
Creating engaging narratives from visual data is crucial for automated digital media consumption, assistive technologies, and interactive entertainment. This survey covers methodol…
GroundCap: A Visually Grounded Image Captioning Dataset
Daniel A. P. Oliveira, Lourenço Teodoro, David Martins de Matos
Current image captioning systems lack the ability to link descriptive text to specific visual elements, making their outputs difficult to verify. While recent approaches offer some…