2 papers
cs.LG2025
Accelerating Prefilling for Long-Context LLMs via Sparse Pattern Sharing
Dan Peng, Zhihui Fu, Zewen Ye +2
Sparse attention methods exploit the inherent sparsity in attention to speed up the prefilling phase of long-context inference, mitigating the quadratic complexity of full attentio…
cs.CV2024
MVQ:Towards Efficient DNN Compression and Acceleration with Masked Vector Quantization
Shuaiting Li, Chengxuan Wang, Juncan Deng +5
Vector quantization(VQ) is a hardware-friendly DNN compression method that can reduce the storage cost and weight-loading datawidth of hardware accelerators. However, conventional…