6 papers
NepPlural: A Human-Anchored Benchmark for Persona Annotation in Nepali Migration Discourse
Jinu Nyachhyon, Anish Khatiwada, Bimal Timilsina
Pluralistic alignment asks that language models faithfully represent a society's diverse, competing values rather than collapse them into one dominant viewpoint, yet flagship plura…
GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models
Yangyue Wang, Harshvardhan Sikka, Yash Mathur +3
GUI grounding models report over 85% accuracy on standard benchmarks, yet drop 27-56 percentage points when instructions require spatial reasoning rather than direct element naming…
Confirmation bias: A challenge for scalable oversight
Gabriel Recchia, Chatrik Singh Mangat, Jinu Nyachhyon +4
Scalable oversight protocols aim to empower evaluators to accurately verify AI models more capable than themselves. However, human evaluators are subject to biases that can lead to…
Local Herb Identification Using Transfer Learning: A CNN-Powered Mobile Application for Nepalese Flora
Prajwal Thapa, Mridul Sharma, Jinu Nyachhyon +1
Herb classification presents a critical challenge in botanical research, particularly in regions with rich biodiversity such as Nepal. This study introduces a novel deep learning a…
Consolidating and Developing Benchmarking Datasets for the Nepali Natural Language Understanding Tasks
Jinu Nyachhyon, Mridul Sharma, Prajwal Thapa +1
The Nepali language has distinct linguistic features, especially its complex script (Devanagari script), morphology, and various dialects,which pose a unique challenge for Natural…
Development of Pre-Trained Transformer-based Models for the Nepali Language
Prajwal Thapa, Jinu Nyachhyon, Mridul Sharma +1
Transformer-based pre-trained language models have dominated the field of Natural Language Processing (NLP) for quite some time now. However, the Nepali language, spoken by approxi…