2 citations · 3 across the 10 of their papers we have counts for
5 papers · 1 filter
DeltaLog: Deferred Materialization of Recurrent States for Linear Attention Decoding
Junqing Lin, Jingwei Sun, Guangzhong Sun
Linear attention models eliminate the quadratic prefix computation and context-growing KV cache of softmax attention by replacing pairwise token interactions with recurrent state u…
FlashQuant: Sparse-Dense Fusion for Memory-Efficient Outlier-Aware LLM Inference
Junqing Lin, Jingwei Sun, Zhengding Hu +1
Low-bit quantization reduces the memory footprint and computational cost of large language model (LLM) inference. However, high-magnitude outlier weights can induce substantial qua…
RSH-SpMM: A Row-Structured Hybrid Kernel for Sparse Matrix-Matrix Multiplication on GPUs
Aiying Li, Jingwei Sun, Han Li +2
Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental computation in graph analytics, scientific simulation, and sparse deep learning workloads. However, the extreme irregula…
Toward Efficient SpMV in Sparse LLMs via Block Extraction and Compressed Storage
Junqing Lin, Jingwei Sun, Mingge Lu +1
Sparse Matrix-Vector Multiplication (SpMV) has become a critical performance bottleneck in the local deployment of sparse Large Language Models (LLMs), where inference predominantl…
Synthesizing Proxy Applications for MPI Programs
Jiyu Luo, Tao Yan, Qingguo Xu +2
Proxy applications (proxy-apps) are basic tools for evaluating the performance of specific workloads on high-performance computing (HPC) systems. Since the development of high-fide…