Rethinking Calibration for High-Sparsity LLM Pruning: From Single Sources to Capability Coverage

Hu Xu, Zhaolong Xing, Congcong Liu +5

Post-training LLM pruning relies on a small calibration set, usually chosen heuristically and judged by WikiText perplexity or by mean accuracy on general-domain commonsense benchm…