Scaling Synthetic Pre-training Data and Evaluation for Indic LLMs

Abhinav Khattar, Aishwarya Chhabra, Ameya Velingker +24

Building capable language models for India requires scalable multilingual data and robust evaluation. We introduce Nemotron-Pretraining-Indic-v1, a synthetic pretraining corpus of…