RobeCzech: Czech RoBERTa, a monolingual contextualized language representation model

Milan Straka, Jakub Náplava, Jana Straková +1

We present RobeCzech, a monolingual RoBERTa language representation model trained on Czech data. RoBERTa is a robustly optimized Transformer-based pretraining approach. We show tha…