most citedUnifiedCrawl: Aggregated Common Crawl for Affordable Adaptation of LLMs on Low-Resource Languages

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CL2024★ 1 cited

UnifiedCrawl: Aggregated Common Crawl for Affordable Adaptation of LLMs on Low-Resource Languages

Bethel Melesse Tessema, Akhil Kedia, Tae-Sun Chung

Large language models (LLMs) under-perform on low-resource languages due to limited training data. We present a method to efficiently collect text data for low-resource languages f…