8 citations · 8 across the 4 of their papers we have counts for
3 papers · 1 filter
The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLP
Henry He, Johann Frei, Raphael Schmitt
Digital healthcare generates vast amounts of clinical text that can support AI-assisted applications, yet German biomedical language models remain limited by older architectures or…
PortBERT: Navigating the Depths of Portuguese Language Models
Raphael Scheible-Schmitt, Henry He, Armando B. Mendes
Transformer models dominate modern NLP, but efficient, language-specific models remain scarce. In Portuguese, most focus on scale or accuracy, often neglecting training and deploym…
GottBERT: a pure German Language Model
Raphael Scheible, Johann Frei, Fabian Thomczyk +6
Pre-trained language models have significantly advanced natural language processing (NLP), especially with the introduction of BERT and its optimized version, RoBERTa. While initia…