IntraSlice: Towards High-Performance Structural Pruning with Block-Intra PCA for LLMs

Meng Li, Peisong Wang, Yuantian Shao +5

Large Language Models (LLMs) achieve strong performance across diverse tasks but face deployment challenges due to their massive size. Structured pruning offers acceleration benefi…