221 citations · 935 across the 44 of their papers we have counts for
13 papers · 1 filter
Towards Coordinated Robot Motions: End-to-End Learning of Motion Policies on Transform Trees
M. Asif Rana, Anqi Li, Dieter Fox +3
Generating robot motion that fulfills multiple tasks simultaneously is challenging due to the geometric constraints imposed by the robot. In this paper, we propose to solve multi-t…
Explainable AI for System Failures: Generating Explanations that Improve Human Assistance in Fault Recovery
Devleena Das, Siddhartha Banerjee, Sonia Chernova
With the growing capabilities of intelligent systems, the integration of artificial intelligence (AI) and robots in everyday life is increasing. However, when interacting in such c…
Same Object, Different Grasps: Data and Semantic Knowledge for Task-Oriented Grasping
Adithyavairavan Murali, Weiyu Liu, Kenneth Marino +2
Despite the enormous progress and generalization in robotic grasping in recent years, existing methods have yet to scale and generalize task-oriented grasping to the same extent. T…
Rearrangement: A Challenge for Embodied AI
Dhruv Batra, Angel X. Chang, Sonia Chernova +9
We describe a framework for research and evaluation in Embodied AI. Our proposal is based on a canonical task: Rearrangement. A standard task can focus the development of new techn…
Bi-directional Domain Adaptation for Sim2Real Transfer of Embodied Navigation Agents
Joanne Truong, Sonia Chernova, Dhruv Batra
Deep reinforcement learning models are notoriously data hungry, yet real-world data is expensive and time consuming to obtain. The solution that many have turned to is to use simul…
Learning Navigation Skills for Legged Robots with Learned Robot Embeddings
Joanne Truong, Denis Yarats, Tianyu Li +4
Recent work has shown results on learning navigation policies for idealized cylinder agents in simulation and transferring them to real wheeled robots. Deploying such navigation po…
Tool Macgyvering: A Novel Framework for Combining Tool Substitution and Construction
Lakshmi Nair, Nithin Shrivatsav, Sonia Chernova
Macgyvering refers to solving problems inventively by using whatever objects are available at hand. Tool Macgyvering is a subset of macgyvering tasks involving a missing tool that…
Feature Guided Search for Creative Problem Solving Through Tool Construction
Lakshmi Nair, Sonia Chernova
Robots in the real world should be able to adapt to unforeseen circumstances. Particularly in the context of tool use, robots may not have access to the tools they need for complet…
Anticipatory Human-Robot Collaboration via Multi-Objective Trajectory Optimization
Abhinav Jain, Daphne Chen, Dhruva Bansal +6
We address the problem of adapting robot trajectories to improve safety, comfort, and efficiency in human-robot collaborative tasks. To this end, we propose CoMOTO, a trajectory op…
Human-Centric Active Perception for Autonomous Observation
David Kent, Sonia Chernova
As robot autonomy improves, robots are increasingly being considered in the role of autonomous observation systems -- free-flying cameras capable of actively tracking human activit…
Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imaging
Zackory Erickson, Eliot Xing, Bharat Srirangam +2
Material recognition can help inform robots about how to properly interact with and manipulate real-world objects. In this paper, we present a multimodal sensing technique, leverag…
Leveraging Rationales to Improve Human Task Performance
Devleena Das, Sonia Chernova
Machine learning (ML) systems across many application areas are increasingly demonstrating performance that is beyond that of humans. In response to the proliferation of such model…
Taking Recoveries to Task: Recovery-Driven Development for Recipe-based Robot Tasks
Siddhartha Banerjee, Angel Daruna, David Kent +9
Robot task execution when situated in real-world environments is fragile. As such, robot architectures must rely on robust error recovery, adding non-trivial complexity to highly-c…