337 citations · 470 across the 50 of their papers we have counts for
4 papers · 1 filter
Language Models are not Equally Robust to Non-Canonical Tokenization across Languages
Poulami Ghosh, Preethi Jyothi
Despite the existence of exponentially many valid tokenizations for a given string, language models operate on a single canonical sequence deterministically produced by the tokeniz…
Are Multilingual Models Actually Improving? Isolating True Cross-Lingual Transfer
Prasoon Bajpai, Eleftheria Briakou, Colin Cherry +2
Cross-lingual transfer is a model's ability to generalize capabilities from well-represented source languages to under-represented target languages. Existing measures of a model's…
XITE: Cross-lingual Interpolation for Transfer using Embeddings
Barah Fazili, Preethi Jyothi
Facilitating cross-lingual transfer in multilingual language models remains a critical challenge. Towards this goal, we propose an embedding-based data augmentation technique calle…
Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics
Sanjeev Kumar, Preethi Jyothi, Pushpak Bhattacharyya
Evaluating machine translation (MT) quality in extremely low-resource language (ELRL) scenarios poses unique challenges, as widely used metrics such as BLEU, effective in high-reso…