51 citations · 92 across the 15 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
Language Model Pre-training on True Negatives
Zhuosheng Zhang, Hai Zhao, Masao Utiyama +1
Discriminative pre-trained language models (PLMs) learn to predict original texts from intentionally corrupted ones. Taking the former text as positive and the latter as negative s…
cs.CL2022
Extending the Subwording Model of Multilingual Pretrained Models for New Languages
Kenji Imamura, Eiichiro Sumita
Multilingual pretrained models are effective for machine translation and cross-lingual processing because they contain multiple languages in one model. However, they are pretrained…