Building Chinese Biomedical Language Models via Multi-Level Text Discrimination

Quan Wang, Songtai Dai, Benfeng Xu +4

Pre-trained language models (PLMs), such as BERT and GPT, have revolutionized the field of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts…