Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression

Kabir Swain, Sijie Han, Daniel Karl I. Weidele +3

We propose \textbf{Hurwitz Quaternion Multiplicative Quantization (HQMQ)}, a \textbf{calibration-free} method for KV cache compression of large language models. HQMQ treats each 4-…