Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM
Sergii Kozyrev, Davyd Maiboroda
Hybrid LLMs pair softmax attention with linear-attention layers such as Gated DeltaNet (GDN), whose recurrent state summarizes the context in fixed size. Early community 4-bit quan…
cs.AI2026
Minima-KV: Retention-Preserving KV Cache Compression with Mixed-Format Paged Attention
Sergii Kozyrev, Davyd Maiboroda
The key-value (KV) cache is a primary capacity and bandwidth bottleneck in long-context LLM serving. We present Minima-KV, a retention-preserving hierarchy for mixed-format paged a…