UER: An Open-Source Toolkit for Pre-training Models

Zhe Zhao, Hui Chen, Jinbin Zhang +7

Existing works, including ELMO and BERT, have revealed the importance of pre-training for NLP tasks. While there does not exist a single pre-training model that works best in all c…