ARCHead: Activation-Metric Residual Correction for Large Language Model Output Heads

Şuayp Talha Kocabay, Talha Rüzgar Akkuş, Kamer Ali Yuksel

Weight-only quantization substantially reduces the storage of large language model (LLM) transformer blocks, but practical backends often retain the final language-modeling head (L…