All-in-One Tuning and Structural Pruning for Domain-Specific LLMs

Lei Lu, Zhepeng Wang, Runxue Bao +7

Existing pruning techniques for large language models (LLMs) targeting domain-specific applications typically follow a two-stage process: pruning the pretrained general-purpose LLM…