171 citations · 183 across the 3 of their papers we have counts for
5 papers
Extending Multilingual BERT to Low-Resource Languages
Zihan Wang, Karthikeyan K, Stephen Mayhew +1
Multilingual BERT (M-BERT) has been a huge success in both supervised and zero-shot cross-lingual transfer learning. However, this success has focused only on the top 104 languages…
Robust Named Entity Recognition with Truecasing Pretraining
Stephen Mayhew, Nitish Gupta, Dan Roth
Although modern named entity recognition (NER) systems show impressive performance on standard datasets, they perform poorly when presented with noisy data. In particular, capitali…
Cross-Lingual Ability of Multilingual BERT: An Empirical Study
Karthikeyan K, Zihan Wang, Stephen Mayhew +1
Recent work has exhibited the surprising cross-lingual abilities of multilingual BERT (M-BERT) -- surprising since it is trained without any cross-lingual objective and with no ali…
Named Entity Recognition with Partially Annotated Training Data
Stephen Mayhew, Snigdha Chaturvedi, Chen-Tse Tsai +1
Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We st…
ner and pos when nothing is capitalized
Stephen Mayhew, Tatiana Tsygankova, Dan Roth
For those languages which use it, capitalization is an important signal for the fundamental NLP tasks of Named Entity Recognition (NER) and Part of Speech (POS) tagging. In fact, i…