2 papers
cs.CL2026
Monte Carlo Estimation for KV Cache Eviction
Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer +5
Most KV-cache eviction methods ask, in effect, which memory appeared important while reading the prompt? We instead ask which memory will matter while answering? Since decoding que…
cs.CL2026
Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation
Atta Ul Asad, Ahsan Bilal, Muhammad Ali +2
Retrieval-augmented generation systems can precompute and store key-value caches of retrieved documents to avoid re-encoding context at every query. Quantizing these caches further…