Exploiting BERT for End-to-End Aspect-based Sentiment Analysis
arXiv:1910.00883
Abstract
In this paper, we investigate the modeling power of contextualized embeddings from pre-trained language models, e.g. BERT, on the E2E-ABSA task. Specifically, we build a series of simple yet insightful neural baselines to deal with E2E-ABSA. The experimental results show that even with a simple linear classification layer, our BERT-based architecture can outperform state-of-the-art works. Besides, we also standardize the comparative study by consistently utilizing a hold-out validation dataset for model selection, which is largely ignored by previous works. Therefore, our work can serve as a BERT-based benchmark for E2E-ABSA.
NUT workshop@EMNLP-IJCNLP-2019
References in corpus (9)
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- Cross-lingual Language Model Pretraining
- A Structured Self-attentive Sentence Embedding
- BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
- Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
- Empower Sequence Labeling with Task-Aware Neural Language Model
- Interactive Attention Networks for Aspect-Level Sentiment Classification
- Learning to Attend via Word-Aspect Associative Fusion for Aspect-based Sentiment Analysis
- Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis