13 citations · 19 across the 7 of their papers we have counts for
8 papers
Learning Neuro-symbolic Programs for Language Guided Robot Manipulation
Namasivayam Kalithasan, Himanshu Singh, Vishal Bindal +5
Given a natural language instruction and an input scene, our goal is to train a model to output a manipulation program that can be executed by the robot. Prior approaches for this…
ToolTango: Common sense Generalization in Predicting Sequential Tool Interactions for Robot Plan Synthesis
Shreshth Tuli, Rajas Bansal, Rohan Paul +1
Robots assisting us in environments such as factories or homes must learn to make use of objects as tools to perform tasks, for instance using a tray to carry objects. We consider…
GoalNet: Inferring Conjunctive Goal Predicates from Human Plan Demonstrations for Robot Instruction Following
Shreya Sharma, Jigyasa Gupta, Shreshth Tuli +2
Our goal is to enable a robot to learn how to sequence its actions to perform tasks specified as natural language instructions, given successful demonstrations from a human partner…
TANGO: Commonsense Generalization in Predicting Tool Interactions for Mobile Manipulators
Shreshth Tuli, Rajas Bansal, Rohan Paul +1
Robots assisting us in factories or homes must learn to make use of objects as tools to perform tasks, e.g., a tray for carrying objects. We consider the problem of learning common…
Multi-facet Universal Schema
Rohan Paul, Haw-Shiuan Chang, Andrew McCallum
Universal schema (USchema) assumes that two sentence patterns that share the same entity pairs are similar to each other. This assumption is widely adopted for solving various type…
Open source software for automatic subregional assessment of knee cartilage degradation using quantitative T2 relaxometry and deep learning
Kevin A. Thomas, Dominik Krzemiński, Łukasz Kidziński +7
Objective: We evaluate a fully-automated femoral cartilage segmentation model for measuring T2 relaxation values and longitudinal changes using multi-echo spin echo (MESE) MRI. We…
ToolNet: Using Commonsense Generalization for Predicting Tool Use for Robot Plan Synthesis
Rajas Bansal, Shreshth Tuli, Rohan Paul +1
A robot working in a physical environment (like home or factory) needs to learn to use various available tools for accomplishing different tasks, for instance, a mop for cleaning a…
Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context
Rohan Paul, Andrei Barbu, Sue Felshin +2
A robot's ability to understand or ground natural language instructions is fundamentally tied to its knowledge about the surrounding world. We present an approach to grounding natu…