LCQ: Low-Rank Codebook based Quantization for Large Language Models

Wen-Pu Cai, Ming-Yang Li, Wu-Jun Li

Large language models~(LLMs) have recently demonstrated promising performance in many tasks. However, the high storage and computational cost of LLMs has become a challenge for dep…