4 papers
Probing Character-level Transformers for the Spanish L-shaped Morphome
Akhilesh Kakolu Ramarao, Kevin Tang, Wiebke Petersen +1
When a transformer learns an irregular morphological pattern, what has it learned? Our test case is the Spanish \emph{L-shaped morphome}, a complex irregular pattern in which the v…
Transformers over-extend what humans underlearn: the case of Spanish L-shaped morphome
Akhilesh Kakolu Ramarao, Kevin Tang, Dinah Baer-Henney
The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical artifacts? A neural network trai…
Keyboards for the Endangered Idu Mishmi Language
Akhilesh Kakolu Ramarao
We present a mobile and desktop keyboard suite for Idu Mishmi, an endangered Trans-Himalayan language spoken by approximately 11,000 people in Arunachal Pradesh, India. Although a…
Character-aware Transformers Learn an Irregular Morphological Pattern Yet None Generalize Like Humans
Akhilesh Kakolu Ramarao, Kevin Tang, Dinah Baer-Henney
Whether neural networks can serve as cognitive models of morphological learning remains an open question. Recent work has shown that encoder-decoder models can acquire irregular pa…