Are Medium-Sized Transformers Models still Relevant for Medical Records Processing?

Boammani Aser Lompo, Thanh-Dung Le, Philippe Jouvet +1

As large language models (LLMs) become the standard in many NLP applications, we explore the potential of medium-sized pretrained transformer models as a viable alternative for med…