3 citations · 3 across the 11 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Sparse Attention as a Range Searching Problem: Towards an Inference-Efficient Index for KV Cache
Mohsen Dehghankar, Abolfazl Asudeh
Sparse attention improves LLM inference efficiency by selecting a subset of key-value entries, but at the cost of potential accuracy degradation. In particular, omitting critical K…
cs.DS2026
RSR-core: A High-Performance Engine for Low-Bit Matrix-Vector Multiplication
Mohsen Dehghankar, Abolfazl Asudeh
Matrix-vector multiplication is a fundamental building block in neural networks, vector databases, and large language models, particularly during inference. As a result, efficient…