EntmaxKV: Support-Aware Decoding for Entmax Attention

Gonçalo Duarte, Miguel Couceiro, Marcos V. Treviso

Long-context decoding is increasingly limited by KV-cache memory traffic since each generated token attends over a cache whose size grows linearly with context length. Existing spa…