Modular Monolingual Adaptation using Pretrained Language Models

Nalin Kumar, Ondřej Dušek

Building monolingual language models (LMs) for low-resource languages typically relies on adapting pretrained language models (PLMs) by finetuning the whole model on the target lan…