MI-PRUN: Optimize Large Language Model Pruning via Mutual Information

Hao Zhang, Zhibin Zhang, Guangxin Wu +3

Large Language Models (LLMs) have become indispensable across various domains, but this comes at the cost of substantial computational and memory resources. Model pruning addresses…