most citedI-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2024★ 1 cited

I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models

Xing Hu, Yuan Cheng, Dawei Yang +4

Post-training quantization (PTQ) serves as a potent technique to accelerate the inference of large language models (LLMs). Nonetheless, existing works still necessitate a considera…