KR-BERT: A Small-Scale Korean-Specific Language Model

Sangah Lee, Hansol Jang, Yunmee Baik +2

Since the appearance of BERT, recent works including XLNet and RoBERTa utilize sentence embedding models pre-trained by large corpora and a large number of parameters. Because such…