1 citations · 4 across the 7 of their papers we have counts for
5 papers · 1 filter
Code as Reward: Empowering Reinforcement Learning with VLMs
David Venuto, Sami Nur Islam, Martin Klissarov +3
Pre-trained Vision-Language Models (VLMs) are able to understand visual concepts, describe and decompose complex tasks into sub-tasks, and provide feedback on task completion. In t…
Multi-Environment Pretraining Enables Transfer to Action Limited Datasets
David Venuto, Sherry Yang, Pieter Abbeel +3
Using massive datasets to train large-scale models has emerged as a dominant approach for broad generalization in natural language and vision applications. In reinforcement learnin…
Policy Gradients Incorporating the Future
David Venuto, Elaine Lau, Doina Precup +1
Reasoning about the future -- understanding how decisions in the present time affect outcomes in the future -- is one of the central challenges for reinforcement learning (RL), esp…
oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actions
David Venuto, Jhelum Chakravorty, Leonard Boussioux +3
Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a soluti…
Avoidance Learning Using Observational Reinforcement Learning
David Venuto, Leonard Boussioux, Junhao Wang +4
Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous be…