LCD: Advancing Extreme Low-Bit Clustering for Large Language Models via Knowledge Distillation

Fangxin Liu, Ning Yang, Junping Zhao +3

Large language models (LLMs) have achieved significant progress in natural language processing but face challenges in deployment due to high memory and computational requirements.…