What do language models model? Transformers, automata, and the format of thought

Colin Klein

What do large language models actually model? Do they tell us something about human capacities, or are they models of the corpus we've trained them on? I give a non-deflationary de…