Decomposing Attention To Find Context-Sensitive Neurons

Alex Gibson

We study transformer language models, analyzing attention heads whose attention patterns are spread out, and whose attention scores depend weakly on content. We argue that the soft…