S. Scardapane

activity

20242026

most citedMixture-of-Experts Graph Transformers for Interpretable Particle Collision Detection

2 citations · 2 across the 1 of their papers we have counts for

collaborators

Showing cs.CLShow all

2 papers · 1 filter

cs.CL2025

Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression

Nathan Godey, Alessio Devoto, Yu Zhao +4

Autoregressive language models rely on a Key-Value (KV) Cache, which avoids re-computing past hidden states during generation, making it faster. As model sizes and context lengths…

cs.CL2024

A Simple and Effective $L_{2}$ Norm-Based Strategy for KV Cache Compression

Alessio Devoto, Yu Zhao, Simone Scardapane +1

The deployment of large language models (LLMs) is often hindered by the extensive memory requirements of the Key-Value (KV) cache, especially as context lengths increase. Existing…

Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression

A Simple and Effective L2​ Norm-Based Strategy for KV Cache Compression

A Simple and Effective $L_{2}$ Norm-Based Strategy for KV Cache Compression