337 citations · 470 across the 50 of their papers we have counts for
57 papers
Language Models are not Equally Robust to Non-Canonical Tokenization across Languages
Poulami Ghosh, Preethi Jyothi
Despite the existence of exponentially many valid tokenizations for a given string, language models operate on a single canonical sequence deterministically produced by the tokeniz…
Are Multilingual Models Actually Improving? Isolating True Cross-Lingual Transfer
Prasoon Bajpai, Eleftheria Briakou, Colin Cherry +2
Cross-lingual transfer is a model's ability to generalize capabilities from well-represented source languages to under-represented target languages. Existing measures of a model's…
XITE: Cross-lingual Interpolation for Transfer using Embeddings
Barah Fazili, Preethi Jyothi
Facilitating cross-lingual transfer in multilingual language models remains a critical challenge. Towards this goal, we propose an embedding-based data augmentation technique calle…
Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics
Sanjeev Kumar, Preethi Jyothi, Pushpak Bhattacharyya
Evaluating machine translation (MT) quality in extremely low-resource language (ELRL) scenarios poses unique challenges, as widely used metrics such as BLEU, effective in high-reso…
LASER: An LLM-based ASR Scoring and Evaluation Rubric
Amruta Parulekar, Preethi Jyothi
Standard ASR evaluation metrics like Word Error Rate (WER) tend to unfairly penalize morphological and syntactic nuances that do not significantly alter sentence semantics. We intr…
DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer
Sona Elza Simon, Preethi Jyothi
Effective cross-lingual transfer remains a critical challenge in scaling the benefits of large language models from high-resource to low-resource languages. Towards this goal, prio…