activity
20152024
most citedPaLM-E: An Embodied Multimodal Language Model

356 citations · 652 across the 18 of their papers we have counts for

collaborators

19 papers

cs.RO2024

RLDG: Robotic Generalist Policy Distillation via Reinforcement Learning

Charles Xu, Qiyang Li, Jianlan Luo +1

Recent advances in robotic foundation models have enabled the development of generalist policies that can adapt to diverse tasks. While these models show impressive flexibility, th…

cs.RO2023★ 18 cited

Robotic Table Tennis: A Case Study into a High Speed Learning System

David B. D'Ambrosio, Jonathan Abelian, Saminda Abeyruwan +32

We present a deep-dive into a real-world robotic learning system that, in previous work, was shown to be capable of hundreds of table tennis rallies with a human and has the abilit…

cs.LG2023★ 356 cited

PaLM-E: An Embodied Multimodal Language Model

Danny Driess, Fei Xia, Mehdi S. M. Sajjadi +19

Large language models excel at a wide range of complex tasks. However, enabling general inference in the real world, e.g., for robotics problems, raises the challenge of grounding.…

cs.RO2022★ 2 cited

GoalsEye: Learning High Speed Precision Table Tennis on a Physical Robot

Tianli Ding, Laura Graesser, Saminda Abeyruwan +5

Learning goal conditioned control in the real world is a challenging open problem in robotics. Reinforcement learning systems have the potential to learn autonomously via trial-and…

cs.RO2022★ 20 cited

Interactive Language: Talking to Robots in Real Time

Corey Lynch, Ayzaan Wahid, Jonathan Tompson +5

We present a framework for building interactive, real-time, natural language-instructable robots in the real world, and we open source related assets (dataset, environment, benchma…

cs.RO2022

Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations

Negin Heravi, Ayzaan Wahid, Corey Lynch +6

Perceptual understanding of the scene and the relationship between its different components is important for successful completion of robotic tasks. Representation learning has bee…