Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
LOOKAT: Lookup-Optimized Key-Attention for Memory-Efficient Transformers
Aryan Karmore
Compressing the KV cache is a required step to deploy large language models on edge devices. Current quantization methods compress storage but fail to reduce bandwidth as attention…
cs.LG2026
ButterflyMoE: Compression-Scalable Ternary Experts via Structured Butterfly Orbits
Aryan Karmore
In current Mixture of Experts (MoE) architectures, linear memory scaling is present, the memory grows as the number of experts increases. independent expert weight matrices req…