Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1

Recently, the efficiency of Large Language Models (LLMs) deployment has become a critical concern in practical applications. While post-training quantization (PTQ) and structural p…