Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpus

Raviraj Joshi, Kanishk Singla, Anusha Kamath +6

Multilingual LLMs support a variety of languages; however, their performance is suboptimal for low-resource languages. In this work, we emphasize the importance of continued pre-tr…