Compact Language, Complex Model Shifts: How and Where Ambiguity and Underspecification Affect LLMs

Michaela Regneri, Nina Scheller, Sören Laue

We analyze how lexical ambiguity and underspecification affect language model training. We create artificial homonyms and artificial hypernyms as pseudowords and analyze the genera…