Lexicosyntactic Inference in Neural Models
arXiv:1808.06232
Abstract
We investigate neural models' ability to capture lexicosyntactic inferences: inferences triggered by the interaction of lexical and syntactic information. We take the task of event factuality prediction as a case study and build a factuality judgment dataset for all English clause-embedding verbs in various syntactic contexts. We use this dataset, which we make publicly available, to probe the behavior of current state-of-the-art neural systems, showing that these systems make certain systematic errors that are clearly visible through the lens of factuality prediction.
References in corpus (7)
- Sequence to Sequence Learning with Neural Networks
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
- A large annotated corpus for learning natural language inference
- SentEval: An Evaluation Toolkit for Universal Sentence Representations
- Learning to Execute
- Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks
- End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures