most citedVQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference

11 citations · 11 across the 2 of their papers we have counts for

collaborators

2 papers

cs.DC2025★ 11 cited

VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference

Zihan Liu, Xinhao Luo, Junxian Guo +11

In this work, we design and implement VQ-LLM, an efficient fused Vector Quantization (VQ) kernel generation framework. We first introduce a software abstraction called codebook cac…

cs.DC2023

JUNO: Optimizing High-Dimensional Approximate Nearest Neighbour Search with Sparsity-Aware Algorithm and Ray-Tracing Core Mapping

Zihan Liu, Wentao Ni, Jingwen Leng +6

Approximate nearest neighbor (ANN) search is a widely applied technique in modern intelligent applications, such as recommendation systems and vector databases. Therefore, efficien…