Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Randomization Boosts KV Caching, Learning Balances Query Load: A Joint Perspective
Fangzhou Wu, Sandeep Silwal, Qiuyi +1
KV caching is a fundamental technique for accelerating Large Language Model (LLM) inference by reusing key-value (KV) pairs from previous queries, but its effectiveness under limit…
cs.LG2023
Computing Approximate Sensitivities
Swati Padmanabhan, David P. Woodruff, Qiuyi Zhang
Recent works in dimensionality reduction for regression tasks have introduced the notion of sensitivity, an estimate of the importance of a specific datapoint in a dataset, offerin…