Correlation-Aware Structured Pruning for Large Language Models

Sicheng Xu, Hao Shi, Wei Zhang +6

Structured pruning is a promising approach for reducing the substantial inference costs of Large Language Models (LLMs) while maintaining hardware efficiency. Many existing methods…