Compressing Large Language Models with PCA Without Performance Loss

Magnus Bengtsson

We demonstrate that Principal Component Analysis (PCA), when applied in a structured manner, either to polar-transformed images or segment-wise to token sequences, enables extreme…