Massive Activations Are Architecturally Robust: A Controlled Scratch/Commitment Residual Stream Test

Maruthi Vemula

Trained transformers reliably develop massive activations, a small number of hidden dimensions whose magnitude is far above the median and which concentrate on the sequence-start t…