DASC: Decay-Aware State Compression for Hybrid Linear-Attention Serving

Yanqi Yu, Pingwei Sun, Jianchao Tan +4

Hybrid linear-attention architectures have recently scaled to large open-weight models, offering quality competitive with full attention while substantially reducing key/value (KV)…