3 citations · 5 across the 11 of their papers we have counts for
7 papers · 1 filter
SplatR : Experience Goal Visual Rearrangement with 3D Gaussian Splatting and Dense Feature Matching
Arjun P S, Andrew Melnik, Gora Chand Nandi
Experience Goal Visual Rearrangement task stands as a foundational challenge within Embodied AI, requiring an agent to construct a robust world model that accurately captures the g…
STEVE-Audio: Expanding the Goal Conditioning Modalities of Embodied Agents in Minecraft
Nicholas Lenzen, Amogh Raut, Andrew Melnik
Recently, the STEVE-1 approach has been introduced as a method for training generative agents to follow instructions in the form of latent CLIP embeddings. In this work, we present…
Object and Contact Point Tracking in Demonstrations Using 3D Gaussian Splatting
Michael Büttner, Jonathan Francis, Helge Rhodin +1
This paper introduces a method to enhance Interactive Imitation Learning (IIL) by extracting touch interaction points and tracking object movement from video demonstrations. The ap…
Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge
Sriram Yenamandra, Arun Ramachandran, Mukul Khanna +42
In order to develop robots that can effectively serve as versatile and capable home assistants, it is crucial for them to reliably perceive and interact with a wide variety of obje…
Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs
Yusuke Mikami, Andrew Melnik, Jun Miura +1
We demonstrate experimental results with LLMs that address robotics task planning problems. Recently, LLMs have been applied in robotics task planning, particularly using a code ge…
Cognitive Planning for Object Goal Navigation using Generative AI Models
Arjun P S, Andrew Melnik, Gora Chand Nandi
Recent advancements in Generative AI, particularly in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), offer new possibilities for integrating cognitive plann…
Zero-shot Imitation Policy via Search in Demonstration Dataset
Federco Malato, Florian Leopold, Andrew Melnik +1
Behavioral cloning uses a dataset of demonstrations to learn a policy. To overcome computationally expensive training procedures and address the policy adaptation problem, we propo…