5 citations · 8 across the 4 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.CL2019
TinyBERT: Distilling BERT for Natural Language Understanding
Xiaoqi Jiao, Yichun Yin, Lifeng Shang +5
Language model pre-training, such as BERT, has significantly improved the performances of many natural language processing tasks. However, pre-trained language models are usually c…
cs.CL2019
Open Named Entity Modeling from Embedding Distribution
Ying Luo, Hai Zhao, Zhuosheng Zhang +1
In this paper, we report our discovery on named entity distribution in a general word embedding space, which helps an open definition on multilingual named entity definition rather…