Showing 2024Show all
3 papers · 1 filter
cs.CL2024
On Importance of Code-Mixed Embeddings for Hate Speech Identification
Shruti Jagdale, Omkar Khade, Gauri Takalikar +2
Code-mixing is the practice of using two or more languages in a single sentence, which often occurs in multilingual communities such as India where people commonly speak multiple l…
cs.CL2024
Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning
Omkar Khade, Shruti Jagdale, Abhishek Phaltankar +2
Large Language Models (LLMs) have demonstrated remarkable multilingual capabilities, yet challenges persist in adapting these models for low-resource languages. In this study, we i…
cs.CL2024
Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpus
Raviraj Joshi, Kanishk Singla, Anusha Kamath +6
Multilingual LLMs support a variety of languages; however, their performance is suboptimal for low-resource languages. In this work, we emphasize the importance of continued pre-tr…