Polish ModernBERT: The Long and Short of Polish Language Understanding

Michał Perełkiewicz, Sławomir Dadas, Rafał Poświata +1

Encoder-only Transformers remain effective for discriminative and representation-learning tasks, yet Polish encoders still largely rely on BERT/RoBERTa-style architectures. We intr…