312 citations · 537 across the 37 of their papers we have counts for
8 papers · 1 filter
Objaverse: A Universe of Annotated 3D Objects
Matt Deitke, Dustin Schwenk, Jordi Salvador +7
Massive data corpora like WebText, Wikipedia, Conceptual Captions, WebImageText, and LAION have propelled recent dramatic progress in AI. Large neural models trained on such datase…
Phone2Proc: Bringing Robust Robots Into Our Chaotic World
Matt Deitke, Rose Hendrix, Luca Weihs +3
Training embodied agents in simulation has become mainstream for the embodied AI community. However, these agents often struggle when deployed in the physical world due to their in…
A General Purpose Supervisory Signal for Embodied Agents
Kunal Pratap Singh, Jordi Salvador, Luca Weihs +1
Training effective embodied AI agents often involves manual reward engineering, expert imitation, specialized components such as maps, or leveraging additional sensors for depth an…
Ask4Help: Learning to Leverage an Expert for Embodied Tasks
Kunal Pratap Singh, Luca Weihs, Alvaro Herrasti +3
Embodied AI agents continue to become more capable every year with the advent of new models, environments, and benchmarks, but are still far away from being performant and reliable…
Retrospectives on the Embodied AI Workshop
Matt Deitke, Dhruv Batra, Yonatan Bisk +36
We present a retrospective on the state of Embodied AI research. Our analysis focuses on 13 challenges presented at the Embodied AI Workshop at CVPR. These challenges are grouped i…
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
Matt Deitke, Eli VanderBilt, Alvaro Herrasti +8
Massive datasets and high-capacity models have driven many recent advancements in computer vision and natural language understanding. This work presents a platform to enable simila…
The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents
Sarah Pratt, Luca Weihs, Ali Farhadi
The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interactio…
Half-Trek Criterion for Identifiability of Latent Variable Models
Rina Foygel Barber, Mathias Drton, Nils Sturma +1
We consider linear structural equation models with latent variables and develop a criterion to certify whether the direct causal effects between the observable variables are identi…