LoPRo: Enhancing Low-Rank Quantization via Permuted Block-Wise Rotation

Hongyaoxing Gu, Lijuan Hu, Liye Yu +2

Post-training quantization (PTQ) enables effective model compression while preserving relatively high accuracy. Current weight-only PTQ methods primarily focus on the challenging s…