High-order Semantic Role Labeling
arXiv:2010.04641
Abstract
Semantic role labeling is primarily used to identify predicates, arguments, and their semantic relationships. Due to the limitations of modeling methods and the conditions of pre-identified predicates, previous work has focused on the relationships between predicates and arguments and the correlations between arguments at most, while the correlations between predicates have been neglected for a long time. High-order features and structure learning were very common in modeling such correlations before the neural network era. In this paper, we introduce a high-order graph structure for the neural semantic role labeling model, which enables the model to explicitly consider not only the isolated predicate-argument pairs but also the interaction between the predicate-argument pairs. Experimental results on 7 languages of the CoNLL-2009 benchmark show that the high-order structural learning techniques are beneficial to the strong performing SRL models and further boost our baseline to achieve new state-of-the-art results.
arXiv commentEMNLP 2020, ACL Findings
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
- Conditional Random Fields as Recurrent Neural Networks
- On the Convergence of Adam and Beyond
- Explicit Contextual Semantics for Text Comprehension
- Semantics-aware BERT for Language Understanding
- Distance-Free Modeling of Multi-Predicate Interactions in End-to-End Japanese Predicate-Argument Structure Analysis
- Efficient Second-Order TreeCRF for Neural Dependency Parsing
- Parsing All: Syntax and Semantics, Dependencies and Spans