Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Attention under Bounded Key-Query Similarity: Space Complexity and Transformer Anisotropy
Justin Y. Chen, Ying Feng, Piotr Indyk +3
A growing body of work on KV-cache compression aims to reduce the memory requirements of autoregressive generation. These methods compress the stored context while approximately pr…
cs.LG2026
Provable Quantization with Randomized Hadamard Transform
Ying Feng, Piotr Indyk, Michael Kapralov +2
Vector quantization via random projection followed by scalar quantization is a fundamental primitive in machine learning, with applications ranging from similarity search to federa…