Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Periodic Weak Spots: Phase Sensitivity from Chunked KV-Cache Compression
Xingyu Zhu, Pu, Yi +6
Chunked KV-cache compression reduces the memory and attention costs of long-context inference by compressing windows of consecutive tokens into fewer cache entries at a fixed strid…
cs.LG2025
Exchangeability in Neural Network and its Application to Dynamic Pruning
Pu, Yi, Tianlang Chen +2
Modern neural networks (NN) contain an ever-growing number of parameters, substantially increasing the memory and computational cost of inference. Researchers have explored various…