200 citations · 212 across the 8 of their papers we have counts for
10 papers
Scaling Synthetic Pre-training Data and Evaluation for Indic LLMs
Abhinav Khattar, Aishwarya Chhabra, Ameya Velingker +24
Building capable language models for India requires scalable multilingual data and robust evaluation. We introduce Nemotron-Pretraining-Indic-v1, a synthetic pretraining corpus of…
Mathematics Isn't Culture-Free: Probing Cultural Gaps via Entity and Scenario Perturbations
Aditya Tomar, Nihar Ranjan Sahoo, Ashish Mittal +2
Although mathematics is often considered culturally neutral, the way mathematical problems are presented can carry implicit cultural context. Existing benchmarks like GSM8K are pre…
Airavata: Introducing Hindi Instruction-tuned LLM
Jay Gala, Thanmay Jayakumar, Jaavid Aktar Husain +8
We announce the initial release of "Airavata," an instruction-tuned LLM for Hindi. Airavata was created by fine-tuning OpenHathi with diverse, instruction-tuning Hindi datasets to…
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities
Settaluri Lakshmi Sravanthi, Meet Doshi, Tankala Pavan Kalyan +3
LLMs have demonstrated remarkable capability for understanding semantics, but they often struggle with understanding pragmatics. To demonstrate this fact, we release a Pragmatics U…
StarCoder: may the source be with you!
Raymond Li, Loubna Ben Allal, Yangtian Zi +64
The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase…
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages
Arnav Mhaske, Harshit Kedia, Sumanth Doddapaneni +4
We present, Naamapadam, the largest publicly available Named Entity Recognition (NER) dataset for the 11 major Indian languages from two language families. The dataset contains mor…
HiNER: A Large Hindi Named Entity Recognition Dataset
Rudra Murthy, Pallab Bhattacharjee, Rahul Sharnagat +3
Named Entity Recognition (NER) is a foundational NLP task that aims to provide class labels like Person, Location, Organisation, Time, and Number to words in free text. Named Entit…
Cognitively Aided Zero-Shot Automatic Essay Grading
Sandeep Mathias, Rudra Murthy, Diptesh Kanojia +1
Automatic essay grading (AEG) is a process in which machines assign a grade to an essay written in response to a topic, called the prompt. Zero-shot AEG is when we train a system t…
Happy Are Those Who Grade without Seeing: A Multi-Task Learning Approach to Grade Essays Using Gaze Behaviour
Sandeep Mathias, Rudra Murthy, Diptesh Kanojia +2
The gaze behaviour of a reader is helpful in solving several NLP tasks such as automatic essay grading. However, collecting gaze behaviour from readers is costly in terms of time a…
Scrambled Translation Problem: A Problem of Denoising UNMT
Tamali Banerjee, Rudra Murthy, Pushpak Bhattacharyya
In this paper, we identify an interesting kind of error in the output of Unsupervised Neural Machine Translation (UNMT) systems like \textit{Undreamt}(footnote). We refer to this e…