activity
20212026
most citedThe GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

52 citations · 62 across the 6 of their papers we have counts for

collaborators
Showing cs.CLShow all

6 papers · 1 filter

cs.CL2026

AfriSUD: A Dependency Treebank Collection for Evaluating Models on African Languages

Happy Buzaaba, Cheikh Mouhamadou Bamba Dione, David Ifeoluwa Adelani +15

Despite their linguistic diversity and global significance, African languages remain underrepresented in research and resources to support NLP. We aim to bridge this gap by introdu…

cs.CL2024★ 1 cited

InkubaLM: A small language model for low-resource African languages

Atnafu Lambebo Tonja, Bonaventure F. P. Dossou, Jessica Ojo +8

High-resource language models often fall short in the African context, where there is a critical need for models that are efficient, accessible, and locally relevant, even amidst s…

cs.CL2023

ÌròyìnSpeech: A multi-purpose Yorùbá Speech Corpus

Tolulope Ogunremi, Kola Tubosun, Anuoluwapo Aremu +2

We introduce ÌròyìnSpeech, a new corpus influenced by the desire to increase the amount of high quality, contemporary Yorùbá speech data, which can be used for both Text-to-Speech…

cs.CL2023★ 8 cited

AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages

Odunayo Ogundepo, Tajuddeen R. Gwadabe, Clara E. Rivera +49

African languages have far less in-language content available digitally, making it challenging for question answering systems to satisfy the information needs of users. Cross-lingu…

cs.CL2022★ 1 cited

AfriWOZ: Corpus for Exploiting Cross-Lingual Transferability for Generation of Dialogues in Low-Resource, African Languages

Tosin Adewumi, Mofetoluwa Adeyemi, Aremu Anuoluwapo +17

Dialogue generation is an important NLP task fraught with many challenges. The challenges become more daunting for low-resource African languages. To enable the creation of dialogu…

cs.CL2021★ 52 cited

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53

We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…