Outlier Dimensions Encode Task-Specific Knowledge

William Rudman, Catherine Chen, Carsten Eickhoff

Representations from large language models (LLMs) are known to be dominated by a small subset of dimensions with exceedingly high variance. Previous works have argued that although…