Cascaded Multi-Granularity Pruning for On-Device LLM Inference in Industrial IoT

Jinghan Wang, Yanjun Chen, Wei Zhang +3

Deploying large language models (LLMs) on Industrial Internet of Things (IIoT) edge devices demands extreme compression, yet existing structured pruning methods collapse at high co…