Local and Global Regimes of Geometric Complexity in Language Model Representations

Arwa Osman, Marco Baroni, Iuri Macocco

Intrinsic dimensionality (ID) is widely used to probe the representational complexity of language models, but it remains unclear whether ID differences reflect properties of langua…