697 citations · 2.5k across the 36 of their papers we have counts for
36 papers
Vision-Language Model Dialog Games for Self-Improvement
Ksenia Konyushkova, Christos Kaplanis, Serkan Cabi +1
The increasing demand for high-quality, diverse training data poses a significant bottleneck in advancing vision-language models (VLMs). This paper presents VLM Dialog Games, a nov…
Rapid Object Annotation
Misha Denil
In this report we consider the problem of rapidly annotating a video with bounding boxes for a novel object. We describe a UI and associated workflow designed to make this process…
RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
Konstantinos Bousmalis, Giulia Vezzani, Dushyant Rao +36
The ability to leverage heterogeneous robotic experience from different robots and tasks to quickly master novel skills and embodiments has the potential to transform robot learnin…
: Policy Representations with Successor Features
Gianluca Scarpellini, Ksenia Konyushkova, Claudio Fantacci +3
This paper describes , a method for representing behaviors of black box policies as feature vectors. The policy representations capture how the statistics of founda…
Vision-Language Models as Success Detectors
Yuqing Du, Ksenia Konyushkova, Misha Denil +5
Detecting successful behaviour is crucial for training intelligent agents. As such, generalisable reward models are a prerequisite for agents that can learn to generalise their beh…
Interactive decoding of words from visual speech recognition models
Brendan Shillingford, Yannis Assael, Misha Denil
This work describes an interactive decoding method to improve the performance of visual speech recognition systems using user input to compensate for the inherent ambiguity of the…