4 citations · 4 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
STAR-KV: Low-Rank KV Cache Compression via Soft Thresholding for Adaptive Rank Control
Priyansh Bhatnagar, Ashkan Moradifirouzabadi, Se-Hyun Yang +3
Low-rank projection has emerged as a promising approach for compressing the KV cache by exploiting hidden-dimension redundancy. However, prior methods rely on fixed or heuristic ra…
cs.LG2024
SoftLMs: Efficient Adaptive Low-Rank Approximation of Language Models using Soft-Thresholding Mechanism
Priyansh Bhatnagar, Linfeng Wen, Mingu Kang
Extensive efforts have been made to boost the performance in the domain of language models by introducing various attention-based transformers. However, the inclusion of linear lay…