45 citations · 120 across the 7 of their papers we have counts for
8 papers
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction Following
Valts Blukis, Ross A. Knepper, Yoav Artzi
We study the problem of learning a robot policy to follow natural language instructions that can be easily extended to reason about new objects. We introduce a few-shot language-co…
An Information-Theoretic Approach to Persistent Environment Monitoring Through Low Rank Model Based Planning and Prediction
Elizabeth A. Ricci, Madeleine Udell, Ross A. Knepper
Robots can be used to collect environmental data in regions that are difficult for humans to traverse. However, limitations remain in the size of region that a robot can directly o…
Formalizing and Guaranteeing* Human-Robot Interaction
Hadas Kress-Gazit, Kerstin Eder, Guy Hoffman +12
Robot capabilities are maturing across domains, from self-driving cars, to bipeds and drones. As a result, robots will soon no longer be confined to safety-controlled industrial se…
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flight
Valts Blukis, Yannick Terme, Eyvind Niklasson +2
We propose a joint simulation and real-world learning framework for mapping navigation instructions and raw first-person observations to continuous control. Our model estimates the…
Usability Squared: Principles for doing good systems research in robotics
Soham Sankaran, Ross A. Knepper
Despite recent major advances in robotics research, massive injections of capital into robotics startups, and significant market appetite for robotic solutions, large-scale real-wo…
Mapping Navigation Instructions to Continuous Control Actions with Position-Visitation Prediction
Valts Blukis, Dipendra Misra, Ross A. Knepper +1
We propose an approach for mapping natural language instructions and raw observations to continuous control of a quadcopter drone. Our model predicts interpretable position-visitat…
Following High-level Navigation Instructions on a Simulated Quadcopter with Imitation Learning
Valts Blukis, Nataly Brukhim, Andrew Bennett +2
We introduce a method for following high-level navigation instructions by mapping directly from images, instructions and pose estimates to continuous low-level velocity commands fo…
A Deformable Interface for Human Touch Recognition using Stretchable Carbon Nanotube Dielectric Elastomer Sensors and Deep Neural Networks
Chris Larson, Josef Spjut, Ross Knepper +1
User interfaces provide an interactive window between physical and virtual environments. A new concept in the field of human-computer interaction is a soft user interface; a compli…