NorBERTo: A ModernBERT Model Trained for Portuguese with 331 Billion Tokens Corpus

Enzo S. N. Silva, Pablo B. Costa, Raphael C. Vlasman +8

High-quality corpora are essential for advancing Natural Language Processing (NLP) in Portuguese. Building on previous encoder-only models such as BERTimbau and Albertina PT-BR, we…