4 papers
BookWorm: A Dataset for Character Description and Analysis
Argyrios Papoudakis, Mirella Lapata, Frank Keller
Characters are at the heart of every story, driving the plot and engaging readers. In this study, we explore the understanding of characters in full-length books, which contain com…
Generating Visual Stories with Grounded and Coreferent Characters
Danyang Liu, Mirella Lapata, Frank Keller
Characters are important in narratives. They move the plot forward, create emotional connections, and embody the story's themes. Visual storytelling methods focus more on the plot…
Visual Storytelling with Question-Answer Plans
Danyang Liu, Mirella Lapata, Frank Keller
Visual storytelling aims to generate compelling narratives from image sequences. Existing models often focus on enhancing the representation of the image sequence, e.g., with exter…
Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings
Spandana Gella, Mirella Lapata, Frank Keller
We introduce a new task, visual sense disambiguation for verbs: given an image and a verb, assign the correct sense of the verb, i.e., the one that describes the action depicted in…