Publications (37)
VoxML: A Visualization Modeling Language
James Pustejovsky, Nikhil Krishnaswamy
TempEval-3: Evaluating Events, Time Expressions, and Temporal Relations
Naushad UzZaman, Hector Llorens, James Allen +3
Learning event representation: As sparse as possible, but not sparser
Tuan Do, James Pustejovsky
Designing Multimodal Datasets for NLP Challenges
James Pustejovsky, Eben Holderness, Jingxuan Tu +4
Multimodal Semantic Simulations of Linguistically Underspecified Motion Events
Nikhil Krishnaswamy, James Pustejovsky
Fine-grained Event Learning of Human-Object Interaction with LSTM-CRF
Tuan Do, James Pustejovsky
Common Ground Tracking in Multimodal Dialogue
Ibrahim Khebour, Kenneth Lai, Mariah Bradford +8
Assessing the Efficacy of Clinical Sentiment Analysis and Topic Extraction in Psychiatric Readmission Risk Prediction
Elena Alvarez-Mellado, Eben Holderness, Nicholas Miller +5
Multimodal Continuation-style Architectures for Human-Robot Interaction
Nikhil Krishnaswamy, James Pustejovsky
An Abstract Specification of VoxML as an Annotation Language
Kiyong Lee, Nikhil Krishnaswamy, James Pustejovsky
Dynamic Epistemic Friction in Dialogue
Timothy Obiso, Kenneth Lai, Abhijnan Nath +2
Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement
Derek Palmer, Yifan Zhu, Kenneth Lai +8
Generating Simulations of Motion Events from Verbal Descriptions
James Pustejovsky, Nikhil Krishnaswamy
Annotation Methodologies for Vision and Language Dataset Creation
Gitit Kehat, James Pustejovsky
ChainNet: Structured Metaphor and Metonymy in WordNet
Rowan Hall Maudslay, Simone Teufel, Francis Bond +1
Exploration and Discovery of the COVID-19 Literature through Semantic Visualization
Jingxuan Tu, Marc Verhagen, Brent Cochran +1
A Formal Analysis of Multimodal Referring Strategies Under Common Ground
Nikhil Krishnaswamy, James Pustejovsky
Clinical TempEval
Steven Bethard, Leon Derczynski, James Pustejovsky +1
Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment
James Pustejovsky, Nikhil Krishnaswamy
ECAT: Event Capture Annotation Tool
Tuan Do, Nikhil Krishnaswamy, James Pustejovsky
Causal schema induction for knowledge discovery
Michael Regan, Jena D. Hwang, Keisuke Sakaguchi +1
Linguistically Conditioned Semantic Textual Similarity
Jingxuan Tu, Keer Xu, Liulu Yue +3
Analysis of Risk Factor Domains in Psychosis Patient Health Records
Eben Holderness, Nicholas Miller, Philip Cawkwell +4
Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise
Nikhil Krishnaswamy, Scott Friedman, James Pustejovsky
TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues
Hannah VanderHoeven, Brady Bhalla, Ibrahim Khebour +11
Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry
Yifan Zhu, Mariah Bradford, Kenneth Lai +4
Dense Paraphrasing for Textual Enrichment
Jingxuan Tu, Kyeongmin Rim, Eben Holderness +1
Representing Inferences and their Lexicalization
David McDonald, James Pustejovsky
Toward a Functional Geometric Algebra for Natural Language Semantics
James Pustejovsky
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation
Qingyun Wang, Manling Li, Xuan Wang +24
Computational Thought Experiments for a More Rigorous Philosophy and Science of the Mind
Iris Oved, Nikhil Krishnaswamy, James Pustejovsky +1
Multimodal Interactive Learning of Primitive Actions
Tuan Do, Nikhil Krishnaswamy, Kyeongmin Rim +1
Neurosymbolic AI for Situated Language Understanding
Nikhil Krishnaswamy, James Pustejovsky
Distinguishing Clinical Sentiment: The Importance of Domain Adaptation in Psychiatric Patient Health Records
Eben Holderness, Philip Cawkwell, Kirsten Bolton +2
Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment
Katherine Krajovic, Nikhil Krishnaswamy, Nathaniel J. Dimick +2
From Propositional to Perceptual Asymmetry: Extending Frictive Policy Optimization to Asymmetric Partial Information Dialogue
Yifan Zhu, Kyeongmin Rim, James Pustejovsky
Situational Grounding within Multimodal Simulations
James Pustejovsky, Nikhil Krishnaswamy