activity
20202026
most citedMEGA: Multilingual Evaluation of Generative AI

14 citations · 33 across the 18 of their papers we have counts for

collaborators
Showing 2022Show all

5 papers · 1 filter

cs.CL2022★ 2 cited

On the Calibration of Massively Multilingual Language Models

Kabir Ahuja, Sunayana Sitaram, Sandipan Dandapat +1

Massively Multilingual Language Models (MMLMs) have recently gained popularity due to their surprising effectiveness in cross-lingual transfer. While there has been much work in ev…

cs.CL2022

Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models

Kabir Ahuja, Shanu Kumar, Sandipan Dandapat +1

Massively Multilingual Transformer based Language Models have been observed to be surprisingly effective on zero-shot transfer across languages, though the performance varies from…

cs.CL2022★ 2 cited

Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages

Kabir Ahuja, Sandipan Dandapat, Sunayana Sitaram +1

Although recent Massively Multilingual Language Models (MMLMs) like mBERT and XLMR support around 100 languages, most existing multilingual NLP benchmarks provide evaluation data i…

cs.CL2022

On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data

Kabir Ahuja, Monojit Choudhury, Sandipan Dandapat

Borrowing ideas from {\em Production functions} in micro-economics, in this paper we introduce a framework to systematically evaluate the performance and cost trade-offs between ma…

cs.CY2022★ 5 cited

Global Readiness of Language Technology for Healthcare: What would it Take to Combat the Next Pandemic?

Ishani Mondal, Kabir Ahuja, Mohit Jain +3

The COVID-19 pandemic has brought out both the best and worst of language technology (LT). On one hand, conversational agents for information dissemination and basic diagnosis have…