Bioformer: an efficient transformer language model for biomedical text mining

Li Fang, Qingyu Chen, Chih-Hsuan Wei +2

Pretrained language models such as Bidirectional Encoder Representations from Transformers (BERT) have achieved state-of-the-art performance in natural language processing (NLP) ta…