From Attention to Activation: Unravelling the Enigmas of Large Language Models

Prannay Kaul, Chengcheng Ma, Ismail Elezi +1

We study two strange phenomena in auto-regressive Transformers: (1) the dominance of the first token in attention heads; (2) the occurrence of large outlier activations in the hidd…