Showing 2026Show all
3 papers · 1 filter
cs.CL2026
Scaling Synthetic Pre-training Data and Evaluation for Indic LLMs
Abhinav Khattar, Aishwarya Chhabra, Ameya Velingker +24
Building capable language models for India requires scalable multilingual data and robust evaluation. We introduce Nemotron-Pretraining-Indic-v1, a synthetic pretraining corpus of…
cs.CL2026
Beyond Initialization Loss: A Systematic Study of Token Embedding Initialization Strategies for LLM Vocabulary Extension
Raviraj Joshi, Utkarsh Vaidya, Sanjay Singh Chauhan +1
Vocabulary extension is an efficient way to adapt pretrained large language models (LLMs) to new languages, but the initialization of newly added token embeddings can strongly affe…
cs.AI2026
FiMI: A Domain-Specific Language Model for Indian Finance Ecosystem
Aboli Kathar, Aman Kumar, Anusha Kamath +37
We present FiMI (Finance Model for India), a domain-specialized financial language model developed by National Payments Corporation of India (NPCI) for Indian digital payment syste…