Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
Can Perplexity Predict Fine-tuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepali
Nishant Luitel, Nirajan Bekoju, Anand Kumar Sah +1
The impact of subword tokenization on language model performance is well-documented for perplexity, with finer granularity consistently reducing this intrinsic metric. However, res…
cs.CL2024
Contextual Spelling Correction with Language Model for Low-resource Setting
Nishant Luitel, Nirajan Bekoju, Anand Kumar Sah +1
The task of Spell Correction(SC) in low-resource languages presents a significant challenge due to the availability of only a limited corpus of data and no annotated spelling corre…