NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models

Shengrui Li, Junzhe Chen, Xueting Han +1

The considerable size of Large Language Models (LLMs) presents notable deployment challenges, particularly on resource-constrained hardware. Structured pruning, offers an effective…