Using Inter-Sentence Diverse Beam Search to Reduce Redundancy in Visual Storytelling
arXiv:1805.11867
Abstract
Visual storytelling includes two important parts: coherence between the story and images as well as the story structure. For image to text neural network models, similar images in the sequence would provide close information for story generator to obtain almost identical sentence. However, repeatedly narrating same objects or events will undermine a good story structure. In this paper, we proposed an inter-sentence diverse beam search to generate a more expressive story. Comparing to some recent models of visual storytelling task, which generate story without considering the generated sentence of the previous picture, our proposed method can avoid generating identical sentence even given a sequence of similar pictures.
Challenge paper in storytelling workshop co-located with NAACL 2018
References in corpus (2)
Cited by in corpus (7)
- Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods
- Informative Visual Storytelling with Cross-modal Rules
- "My Way of Telling a Story": Persona based Grounded Story Generation
- Induction and Reference of Entities in a Visual Story
- Knowledge-Enriched Visual Storytelling
- Plot and Rework: Modeling Storylines for Visual Storytelling
- On How Users Edit Computer-Generated Visual Stories