Hidden Holes: topological aspects of language models

Stephen Fitz, Peter Romero, Jiyan Jonas Schneider

We explore the topology of representation manifolds arising in autoregressive neural language models trained on raw text data. In order to study their properties, we introduce tool…