Building Context-aware Clause Representations for Situation Entity Type Classification

Abstract

Capabilities to categorize a clause based on the type of situation entity (e.g., events, states and generic statements) the clause introduces to the discourse can benefit many NLP applications. Observing that the situation entity type of a clause depends on discourse functions the clause plays in a paragraph and the interpretation of discourse functions depends heavily on paragraph-wide contexts, we propose to build context-aware clause representations for predicting situation entity types of clauses. Specifically, we propose a hierarchical recurrent neural network model to read a whole paragraph at a time and jointly learn representations for all the clauses in the paragraph by extensively modeling context influences and inter-dependencies of clauses. Experimental results show that our model achieves the state-of-the-art performance for clause-level situation entity classification on the genre-rich MASC+Wiki corpus, which approaches human-level performance.

arXiv commentAccepted by EMNLP 2018

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Improving neural networks by preventing co-adaptation of feature detectors
• A Hierarchical Neural Autoencoder for Paragraphs and Documents
• Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme
• Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network