Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Attention Sinks in Massively Multilingual Neural Machine Translation:Discovery, Analysis, and Mitigation
Hillary Mutisya, John Mugane
Cross-attention patterns in neural machine translation (NMT) are widely used to study how multilingual models align linguistic structure. We report a systematic artifact in cross-a…
cs.LG2026
Neural Recovery of Historical Lexical Structure in Bantu Languages from Modern Data
Hillary Mutisya, John Mugane
We investigate whether neural models trained exclusively on modern morphological data can recover cross-lingual lexical structure consistent with historical reconstruction. Using B…
cs.LG2026
Zero-Shot Morphological Discovery in Low-Resource Bantu Languages via Cross-Lingual Transfer and Unsupervised Clustering
Hillary Mutisya, John Mugane
We present a method for discovering morphological features in low-resource Bantu languages by combining cross-lingual transfer learning with unsupervised clustering. Applied to Gir…