2 citations · 3 across the 15 of their papers we have counts for
1 paper · 2 filters
Yi Su, Xinchen Luo, Hongtao Cheng +7
Quantized inference has demonstrated substantial system-level benefits in large language models while preserving model quality. In contrast, reliably applying low-precision quantiz…