2 papers
cs.LG2026
KVzap: Fast, Adaptive, and Faithful KV Cache Pruning
Simon Jegou, Maximilian Jeblick
Growing context lengths in transformer-based language models have made the key-value (KV) cache a critical inference bottleneck. While many KV cache pruning methods have been propo…
cs.CL2024
Winning Amazon KDD Cup'24
Chris Deotte, Ivan Sorokin, Ahmet Erdem +3
This paper describes the winning solution of all 5 tasks for the Amazon KDD Cup 2024 Multi Task Online Shopping Challenge for LLMs. The challenge was to build a useful assistant, a…