22 citations · 55 across the 28 of their papers we have counts for
3 papers · 1 filter
Neurosymbolic AI for Situated Language Understanding
Nikhil Krishnaswamy, James Pustejovsky
In recent years, data-intensive AI, particularly the domain of natural language processing and understanding, has seen significant progress driven by the advent of large datasets a…
Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment
Katherine Krajovic, Nikhil Krishnaswamy, Nathaniel J. Dimick +2
We present a new interface for controlling a navigation robot in novel environments using coordinated gesture and language. We use a TurtleBot3 robot with a LIDAR and a camera, an…
A Formal Analysis of Multimodal Referring Strategies Under Common Ground
Nikhil Krishnaswamy, James Pustejovsky
In this paper, we present an analysis of computationally generated mixed-modality definite referring expressions using combinations of gesture and linguistic descriptions. In doing…