Probing Character-level Transformers for the Spanish L-shaped Morphome

Akhilesh Kakolu Ramarao, Kevin Tang, Wiebke Petersen +1

When a transformer learns an irregular morphological pattern, what has it learned? Our test case is the Spanish \emph{L-shaped morphome}, a complex irregular pattern in which the v…