activity
20232026
most citedINCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge

4 citations · 4 across the 6 of their papers we have counts for

collaborators

6 papers

cs.LG2026

Causal Risk Minimization for High-Dimensional Treatments

Nikita Dhawan, Arnav Paruthi, Andrew Kim +3

Predicting the effect of interventions with many possible variations, e.g., therapeutic content that affects mental health outcomes or an earnings call transcript that drives movem…

cs.CL2025

AFRICAPTION: Establishing a New Paradigm for Image Captioning in African Languages

Mardiyyah Oduwole, Prince Mireku, Fatimo Adebanjo +3

Multimodal AI research has overwhelmingly focused on high-resource languages, hindering the democratization of advancements in the field. To address this, we present AfriCaption, a…

cs.CL2025

Consistency in Language Models: Current Landscape, Challenges, and Future Directions

Jekaterina Novikova, Carol Anderson, Borhane Blili-Hamelin +2

The hallmark of effective language use lies in consistency: expressing similar meanings in similar contexts and avoiding contradictions. While human communication naturally demonst…

cs.CL2025

Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation

Israfel Salazar, Manuel Fernández Burda, Shayekh Bin Islam +42

The evaluation of vision-language models (VLMs) has mainly relied on English-language benchmarks, leaving significant gaps in both multilingual and multicultural coverage. While mu…

cs.CL2024★ 4 cited

INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge

Angelika Romanou, Negar Foroutan, Anna Sotnikova +56

The performance differential of large language models (LLM) between languages hinders their effective deployment in many regions, inhibiting the potential economic and societal val…

cs.LG2023

Out of the Ordinary: Spectrally Adapting Regression for Covariate Shift

Benjamin Eyre, Elliot Creager, David Madras +2

Designing deep neural network classifiers that perform robustly on distributions differing from the available training data is an active area of machine learning research. However,…