10 citations · 26 across the 16 of their papers we have counts for
5 papers · 1 filter
Dynamic Planning with a LLM
Gautier Dagan, Frank Keller, Alex Lascarides
While Large Language Models (LLMs) can solve many NLP tasks in zero-shot settings, applications involving embodied agents remain problematic. In particular, complex plans that requ…
Meta-learning For Vision-and-language Cross-lingual Transfer
Hanxu Hu, Frank Keller
Current pre-trained vison-language models (PVLMs) achieve excellent performance on a range of multi-modal datasets. Recent work has aimed at building multilingual models, and a ran…
Detecting and Grounding Important Characters in Visual Stories
Danyang Liu, Frank Keller
Characters are essential to the plot of any story. Establishing the characters before writing a story can improve the clarity of the plot and the overall flow of the narrative. How…
Learning Action Changes by Measuring Verb-Adverb Textual Relationships
Davide Moltisanti, Frank Keller, Hakan Bilen +1
The goal of this work is to understand the way actions are performed in videos. That is, given a video, we aim to predict an adverb indicating a modification applied to the action…
Learning the Effects of Physical Actions in a Multi-modal Environment
Gautier Dagan, Frank Keller, Alex Lascarides
Large Language Models (LLMs) handle physical commonsense information inadequately. As a result of being trained in a disembodied setting, LLMs often fail to predict an action's out…