Adaptation of Biomedical and Clinical Pretrained Models to French Long Documents: A Comparative Study

Adrien Bazoge, Emmanuel Morin, Beatrice Daille +1

Recently, pretrained language models based on BERT have been introduced for the French biomedical domain. Although these models have achieved state-of-the-art results on biomedical…