Why Smaller Is Slower? Dimensional Misalignment in Compressed LLMs

Jihao Xin, Tian Lyu, Qilong Pan +2

Post-training compression reduces LLM parameter counts but often produces irregular tensor dimensions that degrade GPU performance -- a phenomenon we call \emph{dimensional misalig…