Pre-training technique to localize medical BERT and enhance biomedical BERT

Shoya Wada, Toshihiro Takeda, Shiro Manabe +3

Pre-training large-scale neural language models on raw texts has made a significant contribution to improving transfer learning in natural language processing (NLP). With the intro…