Quantized Inference for OneRec-V2

Yi Su, Xinchen Luo, Hongtao Cheng +7

Quantized inference has demonstrated substantial system-level benefits in large language models while preserving model quality. In contrast, reliably applying low-precision quantiz…