2 papers
cs.AI2026
Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM
Sergii Kozyrev, Davyd Maiboroda
Hybrid LLMs pair softmax attention with linear-attention layers such as Gated DeltaNet (GDN), whose recurrent state summarizes the context in fixed size. Early community 4-bit quan…
cs.LG2026
A Practical Tensor-Network Compression Pipeline for Production-Scale Large Language Models
Sergii Kozyrev, Davyd Maiboroda
Large language models are limited in deployment by GPU memory and inference latency. We present Minima, a production compression pipeline that learns where and how to structurally…