Low-Resource Name Tagging Learned with Weakly Labeled Data
arXiv:1908.09659
Abstract
Name tagging in low-resource languages or domains suffers from inadequate training data. Existing work heavily relies on additional information, while leaving those noisy annotations unexplored that extensively exist on the web. In this paper, we propose a novel neural model for name tagging solely based on weakly labeled (WL) data, so that it can be applied in any low-resource settings. To take the best advantage of all WL sentences, we split them into high-quality and noisy portions for two modules, respectively: (1) a classification module focusing on the large portion of noisy data can efficiently and robustly pretrain the tag classifier by capturing textual context semantics; and (2) a costly sequence labeling module focusing on high-quality data utilizes Partial-CRFs with non-entity sampling to achieve global optimum. Two modules are combined via shared parameters. Extensive experiments involving five low-resource languages and fine-grained food domain demonstrate our superior performance (6% and 7.8% F1 gains on average) as well as efficiency.
arXiv comment10 pages, 4 figures, EMNLP2019
References in corpus (8)
- Natural Language Processing (almost) from Scratch
- Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences
- Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks
- Few-shot classification in Named Entity Recognition Task
- Weakly Supervised Cross-Lingual Named Entity Recognition via Effective Annotation and Representation Projection
- Neural Collective Entity Linking
- Few-shot Learning for Named Entity Recognition in Medical Text
- Improving Neural Relation Extraction with Implicit Mutual Relations