QUAD: Quantization and Parameter-Efficient Tuning of LLM with Activation Decomposition

Yuxuan Hu, Xiaodong Chen, Cuiping Li +2

Large Language Models (LLMs) excel in diverse applications but suffer inefficiency due to massive scale. While quantization reduces computational costs, existing methods degrade ac…