2 papers
cs.CL2025
Mathematics Isn't Culture-Free: Probing Cultural Gaps via Entity and Scenario Perturbations
Aditya Tomar, Nihar Ranjan Sahoo, Ashish Mittal +2
Although mathematics is often considered culturally neutral, the way mathematical problems are presented can carry implicit cultural context. Existing benchmarks like GSM8K are pre…
cs.LG2024
INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages
Abhishek Kumar Singh, Vishwajeet kumar, Rudra Murthy +3
Large Language Models (LLMs) perform well on unseen tasks in English, but their abilities in non English languages are less explored due to limited benchmarks and training data. To…