Why transformers are obviously good models of language

Felix Hill

Nobody knows how language works, but many theories abound. Transformers are a class of neural networks that process language automatically with more success than alternatives, both…