activity
20232025
most citedFast Inference of Mixture-of-Experts Language Models with Offloading

7 citations · 7 across the 3 of their papers we have counts for

collaborators
Showing 2025Show all

1 paper · 1 filter

cs.LG2025

Cache Me If You Must: Adaptive Key-Value Quantization for Large Language Models

Alina Shutova, Vladimir Malinovskii, Vage Egiazarian +5

Efficient real-world deployments of large language models (LLMs) rely on Key-Value (KV) caching for processing and generating long outputs, reducing the need for repetitive computa…