4 papers
Personalized Embodied Navigation for Portable Object Finding
Vishnu Sashank Dorbala, Bhrij Patel, Amrit Singh Bedi +1
Embodied navigation methods commonly operate in static environments with stationary objects. In this work, we present approaches for tackling navigation in dynamic scenarios with n…
MemCtrl: Using MLLMs as Active Memory Controllers on Embodied Agents
Vishnu Sashank Dorbala, Dinesh Manocha
Foundation models rely on in-context learning for personalized decision making. The limited size of this context window necessitates memory compression and retrieval systems like R…
Is the House Ready For Sleeptime? Generating and Evaluating Situational Queries for Embodied Question Answering
Vishnu Sashank Dorbala, Prasoon Goyal, Robinson Piramuthu +3
We present and tackle the problem of Embodied Question Answering (EQA) with Situational Queries (S-EQA) in a household environment. Unlike prior EQA work tackling simple queries th…
Multi-LLM QA with Embodied Exploration
Bhrij Patel, Vishnu Sashank Dorbala, Amrit Singh Bedi +1
Large language models (LLMs) have grown in popularity due to their natural language interface and pre trained knowledge, leading to rapidly increasing success in question-answering…