2 citations · 6 across the 8 of their papers we have counts for
3 papers · 1 filter
SERENGETI: Massively Multilingual Language Models for Africa
Ife Adebara, AbdelRahim Elmadany, Muhammad Abdul-Mageed +1
Multilingual pretrained language models (mPLMs) acquire valuable, generalizable linguistic information during pretraining and have advanced the state of the art on task-specific fi…
JASMINE: Arabic GPT Models for Few-Shot Learning
El Moatez Billah Nagoudi, Muhammad Abdul-Mageed, AbdelRahim Elmadany +2
Scholarship on generative pretraining (GPT) remains acutely Anglocentric, leaving serious gaps in our understanding of the whole class of autoregressive models. For example, we hav…
AfroLID: A Neural Language Identification Tool for African Languages
Ife Adebara, AbdelRahim Elmadany, Muhammad Abdul-Mageed +1
Language identification (LID) is a crucial precursor for NLP, especially for mining web data. Problematically, most of the world's 7000+ languages today are not covered by LID tech…