106 citations · 342 across the 14 of their papers we have counts for
4 papers · 1 filter
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky +8
What are the units of text that we want to model? From bytes to multi-word expressions, text can be analyzed and generated at many granularities. Until recently, most natural langu…
What's in a Name? Answer Equivalence For Open-Domain Question Answering
Chenglei Si, Chen Zhao, Jordan Boyd-Graber
A flaw in QA evaluation is that annotations often only provide one gold answer. Thus, model predictions semantically equivalent to the answer but superficially different are consid…
Adversarial Training for Machine Reading Comprehension with Virtual Embeddings
Ziqing Yang, Yiming Cui, Chenglei Si +4
Adversarial training (AT) as a regularization method has proved its effectiveness on various tasks. Though there are successful applications of AT on some NLP tasks, the distinguis…
Sub-Character Tokenization for Chinese Pretrained Language Models
Chenglei Si, Zhengyan Zhang, Yingfa Chen +6
Tokenization is fundamental to pretrained language models (PLMs). Existing tokenization methods for Chinese PLMs typically treat each character as an indivisible token. However, th…