most citedBitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CL2024★ 1 cited

BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation

Dayou Du, Yijia Zhang, Shijie Cao +4

The upscaling of Large Language Models (LLMs) has yielded impressive advances in natural language processing, yet it also poses significant deployment challenges. Weight quantizati…