1 citations · 1 across the 4 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
MiLMo:Minority Multilingual Pre-trained Language Model
Junjie Deng, Hanru Shi, Xinhe Yu +3
Pre-trained language models are trained on large-scale unsupervised data, and they can fine-turn the model only on small-scale labeled datasets, and achieve good results. Multiling…
cs.CL2022
TiBERT: Tibetan Pre-trained Language Model
Yuan Sun, Sisi Liu, Junjie Deng +1
The pre-trained language model is trained on large-scale unlabeled text and can achieve state-of-the-art results in many different downstream tasks. However, the current pre-traine…