Yseop at SemEval-2020 Task 5: Cascaded BERT Language Model for Counterfactual Statement Analysis
arXiv:2005.08519
Abstract
In this paper, we explore strategies to detect and evaluate counterfactual sentences. We describe our system for SemEval-2020 Task 5: Modeling Causal Reasoning in Language: Detecting Counterfactuals. We use a BERT base model for the classification task and build a hybrid BERT Multi-Layer Perceptron system to handle the sequence identification task. Our experiments show that while introducing syntactic and semantic features does little in improving the system in the classification task, using these types of features as cascaded linear inputs to fine-tune the sequence-delimiting ability of the model ensures it outperforms other similar-purpose complex systems like BiLSTM-CRF in the second task. Our system achieves an F1 score of 85.00% in Task 1 and 83.90% in Task 2.
References in corpus (4)
- Deeper Text Understanding for IR with Contextual Neural Language Modeling
- Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
- Causality Extraction based on Self-Attentive BiLSTM-CRF with Transferred Embeddings
- Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Survey