RoBERTurk: Adjusting RoBERTa for Turkish

Nuri Tas

We pretrain RoBERTa on a Turkish corpora using BPE tokenizer. Our model outperforms BERTurk family models on the BOUN dataset for the POS task while resulting in underperformance o…