13 citations · 26 across the 9 of their papers we have counts for
Showing cs.DCShow all
3 papers · 1 filter
cs.DC2025★ 11 cited
VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference
Zihan Liu, Xinhao Luo, Junxian Guo +11
In this work, we design and implement VQ-LLM, an efficient fused Vector Quantization (VQ) kernel generation framework. We first introduce a software abstraction called codebook cac…
cs.DC2024
Accelerating Sparse DNNs Based on Tiled GEMM
Cong Guo, Fengchen Xue, Jingwen Leng +5
Network pruning can reduce the computation cost of deep neural network (DNN) models. However, sparse models often produce randomly-distributed weights to maintain accuracy, leading…
cs.DC2020★ 13 cited
Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity
Cong Guo, Bo Yang Hsueh, Jingwen Leng +7
Network pruning can reduce the high computation cost of deep neural network (DNN) models. However, to maintain their accuracies, sparse models often carry randomly-distributed weig…