Cross-Domain Contract Element Extraction with a Bi-directional Feedback Clause-Element Relation Network

Abstract

Contract element extraction (CEE) is the novel task of automatically identifying and extracting legally relevant elements such as contract dates, payments, and legislation references from contracts. Automatic methods for this task view it as a sequence labeling problem and dramatically reduce human labor. However, as contract genres and element types may vary widely, a significant challenge for this sequence labeling task is how to transfer knowledge from one domain to another, i.e., cross-domain CEE. Cross-domain CEE differs from cross-domain named entity recognition (NER) in two important ways. First, contract elements are far more fine-grained than named entities, which hinders the transfer of extractors. Second, the extraction zones for cross-domain CEE are much larger than for cross-domain NER. As a result, the contexts of elements from different domains can be more diverse. We propose a framework, the Bi-directional Feedback cLause-Element relaTion network (Bi-FLEET), for the cross-domain CEE task that addresses the above challenges. Bi-FLEET has three main components: (1) a context encoder, (2) a clause-element relation encoder, and (3) an inference layer. To incorporate invariant knowledge about element and clause types, a clause-element graph is constructed across domains and a hierarchical graph neural network is adopted in the clause-element relation encoder. To reduce the influence of context variations, a multi-task framework with a bi-directional feedback scheme is designed in the inference layer, conducting both clause classification and element extraction. The experimental results over both cross-domain NER and CEE tasks show that Bi-FLEET significantly outperforms state-of-the-art baselines.

arXiv commentAccepted by SIGIR2021

References in corpus (10)

• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
• Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
• A Survey on Deep Learning for Named Entity Recognition
• Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks
• Transfer Learning for Named-Entity Recognition with Neural Networks
• Should Graph Convolution Trust Neighbors? A Simple Causal Inference Method
• Building Legal Case Retrieval Systems with Lexical Matching and Summarization using A Pre-Trained Phrase Scoring Model
• Effective Use of Bidirectional Language Modeling for Transfer Learning in Biomedical Named Entity Recognition
• Encoded Summarization: Summarizing Documents into Continuous Vector Space for Legal Case Retrieval
• Legal Question Answering using Ranking SVM and Deep Convolutional Neural Network