6 papers
What, When, and How: Audio Description as Constrained Global Optimization
Igor Sterner, Mirella Lapata, Alex Lascarides +1
Audio Description (AD) makes movies accessible to blind and visually impaired audiences by narrating visual information in gaps between dialogue. Existing automatic AD systems larg…
Comparing British and American Audio Description of Movies
Igor Sterner, Alex Lascarides, Frank Keller
Narrating the visual component of movies is known as audio description. It is a narrative technique designed to enable blind and visually impaired individuals to follow the story.…
REFRAMED: Towards Realistic Audio Description Generation for Movies
Igor Sterner, Mirella Lapata, Alex Lascarides +1
Audio Description (AD) is a verbal narration of key visual content in videos, enabling access for visually impaired audiences. Unlike standard video captioning, AD is a structured…
Contrastive Learning with Narrative Twins for Modeling Story Salience
Igor Sterner, Alex Lascarides, Frank Keller
Understanding narratives requires identifying which events are most salient for a story's progression. We present a contrastive learning framework for modeling narrative salience t…
: How to learn from procedural How-to questions
Gautier Dagan, Frank Keller, Alex Lascarides
An agent facing a planning problem can use answers to how-to questions to reduce uncertainty and fill knowledge gaps, helping it solve both current and future tasks. However, their…
Plancraft: an evaluation dataset for planning with LLM agents
Gautier Dagan, Frank Keller, Alex Lascarides
We present Plancraft, a multi-modal evaluation dataset for LLM agents. Plancraft has both a text-only and multi-modal interface, based on the Minecraft crafting GUI. We include the…