5 papers
Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures
Tyler A. Chang, Catherine Arnett, Abdelrahman Sadallah +377
To date, there exist almost no culturally-specific evaluation benchmarks for large language models (LLMs) that cover a large number of languages and cultures. In this paper, we pre…
Apriel-1.5-15b-Thinker
Shruthan Radhakrishna, Aman Tiwari, Aanjaneya Shukla +21
We present Apriel-1.5-15B-Thinker, a 15-billion parameter open-weights multimodal reasoning model that achieves frontier-level performance through training design rather than sheer…
Apriel-Nemotron-15B-Thinker
Shruthan Radhakrishna, Soham Parikh, Gopal Sarda +32
While large language models (LLMs) have achieved remarkable reasoning capabilities across domains like code, math and other enterprise tasks, their significant memory and computati…
CURE: A Dataset for Clinical Understanding & Retrieval Evaluation
Nadia Athar Sheikh, Daniel Buades Marcos, Anne-Laure Jousse +3
Given the dominance of dense retrievers that do not generalize well beyond their training dataset distributions, domain-specific test sets are essential in evaluating retrieval. Th…
Improving Multilingual Math Reasoning for African Languages
Odunayo Ogundepo, Akintunde Oladipo, Kelechi Ogueji +3
Researchers working on low-resource languages face persistent challenges due to limited data availability and restricted access to computational resources. Although most large lang…