5 citations · 6 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
E8 Lattice Key Quantization for Low-Bit KV-Cache Compression
Sasho Nedelkoski, Alexander Acker, Soeren Becker +2
Compressing the key-value (KV) cache is essential for serving long-context large language models (LLMs) under memory constraints. While current scalar quantization methods achieve…
cs.LG2025
Distributed Low-Communication Training with Decoupled Momentum Optimization
Sasho Nedelkoski, Alexander Acker, Odej Kao +2
The training of large models demands substantial computational resources, typically available only in data centers with high-bandwidth interconnects. However, reducing the reliance…