activity
20232026
most citedMEGA: Multilingual Evaluation of Generative AI

14 citations · 16 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2026

Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communities

Millicent Ochieng, Felermino D. M. A. Ali, Elizabeth A. Ankrah +8

In this paper, we examine how well AI-generated multimodal stories align with the lived practices, relationships, language, values, and visual expectations of the communities they…

cs.CL2025

Reasoning Beyond Labels: Measuring LLM Sentiment in Low-Resource, Culturally Nuanced Contexts

Millicent Ochieng, Anja Thieme, Ignatius Ezeani +5

Sentiment analysis in low-resource, culturally nuanced contexts challenges conventional NLP approaches that assume fixed labels and universal affective expressions. We present a di…

cs.HC2024

AI and the Future of Work in Africa White Paper

Jacki O'Neill, Vukosi Marivate, Barbara Glover +71

This white paper is the output of a multidisciplinary workshop in Nairobi (Nov 2023). Led by a cross-organisational team including Microsoft Research, NEPAD, Lelapa AI, and Univers…

cs.CL2024★ 2 cited

BEnQA: A Question Answering and Reasoning Benchmark for Bengali and English

Sheikh Shafayat, H M Quamran Hasan, Minhajur Rahman Chowdhury Mahim +3

In this study, we introduce BEnQA, a dataset comprising parallel Bengali and English exam questions for middle and high school levels in Bangladesh. Our dataset consists of approxi…

cs.CL2023★ 14 cited

MEGA: Multilingual Evaluation of Generative AI

Kabir Ahuja, Harshita Diddee, Rishav Hada +9

Generative AI models have shown impressive performance on many Natural Language Processing tasks such as language understanding, reasoning, and language generation. An important qu…