44 citations · 80 across the 4 of their papers we have counts for
5 papers · 1 filter
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
Ishika Singh, Valts Blukis, Arsalan Mousavian +6
Task planning can require defining myriad domain knowledge about the world in which a robot needs to act. To ameliorate that effort, large language models (LLMs) can be used to sco…
Correcting Robot Plans with Natural Language Feedback
Pratyusha Sharma, Balakumar Sundaralingam, Valts Blukis +5
When humans design cost or goal specifications for robots, they often produce specifications that are ambiguous, underspecified, or beyond planners' ability to solve. In these case…
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction Following
Valts Blukis, Ross A. Knepper, Yoav Artzi
We study the problem of learning a robot policy to follow natural language instructions that can be easily extended to reason about new objects. We introduce a few-shot language-co…
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flight
Valts Blukis, Yannick Terme, Eyvind Niklasson +2
We propose a joint simulation and real-world learning framework for mapping navigation instructions and raw first-person observations to continuous control. Our model estimates the…
Mapping Navigation Instructions to Continuous Control Actions with Position-Visitation Prediction
Valts Blukis, Dipendra Misra, Ross A. Knepper +1
We propose an approach for mapping natural language instructions and raw observations to continuous control of a quadcopter drone. Our model predicts interpretable position-visitat…