Ablation, Statistical Inference, and Validation for KV-Cache Compression

Paolo D'Alberto, Ashish Siarasao, Elliott Delaye +1

This study systematically compares Turbo-Quant and SpectralQuant KV-cache compression, evaluating non-dominated schemes, including WHT rotation with Beta Lloyd-Max and QJL, through…