125 citations · 405 across the 21 of their papers we have counts for
21 papers
Learning to Model the World with Language
Jessy Lin, Yuqing Du, Olivia Watkins +4
To interact with humans and act in the world, agents need to understand the range of language that people use and relate it to the visual world. While current agents can learn to e…
DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models
Ying Fan, Olivia Watkins, Yuqing Du +7
Learning from human feedback has been shown to improve text-to-image models. These techniques first learn a reward function that captures what humans care about in the task and the…
Vision-Language Models as Success Detectors
Yuqing Du, Ksenia Konyushkova, Misha Denil +5
Detecting successful behaviour is crucial for training intelligent agents. As such, generalisable reward models are a prerequisite for agents that can learn to generalise their beh…
Aligning Text-to-Image Models using Human Feedback
Kimin Lee, Hao Liu, Moonkyung Ryu +6
Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text…
Guiding Pretraining in Reinforcement Learning with Large Language Models
Yuqing Du, Olivia Watkins, Zihan Wang +5
Reinforcement learning algorithms typically struggle in the absence of a dense, well-shaped reward function. Intrinsically motivated exploration methods address this limitation by…
Practical Imitation Learning in the Real World via Task Consistency Loss
Mohi Khansari, Daniel Ho, Yuqing Du +6
Recent work in visual end-to-end learning for robotics has shown the promise of imitation learning across a variety of tasks. Such approaches are expensive both because they requir…